Jul 03 12:40:25 devstack cinder-volume[75503]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 12:40:25 devstack cinder-volume[75503]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 12:40:25 devstack cinder-volume[75503]: we strongly recommend against using it for new projects.
Jul 03 12:40:25 devstack cinder-volume[75503]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 12:40:25 devstack cinder-volume[75503]: framework.  For more detail see
Jul 03 12:40:25 devstack cinder-volume[75503]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 12:40:25 devstack cinder-volume[75503]:   import eventlet  # noqa
Jul 03 12:40:28 devstack cinder-volume[75503]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:40:28 devstack cinder-volume[75503]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:40:28 devstack cinder-volume[75503]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:40:29 devstack cinder-volume[75503]: INFO dbcounter [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Registered counter for database cinder
Jul 03 12:40:29 devstack cinder-volume[75503]: DEBUG oslo_db.sqlalchemy.engines [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75503) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:40:29 devstack cinder-volume[75503]: DEBUG dbcounter [-] [75503] Writer thread running {{(pid=75503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:40:29 devstack cinder-volume[75503]: INFO cinder.rpc [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 12:40:29 devstack cinder-volume[75503]: INFO cinder.rpc [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 12:40:29 devstack cinder-volume[75503]: DEBUG oslo_db.sqlalchemy.engines [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75503) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:40:29 devstack cinder-volume[75503]: INFO cinder.volume.manager [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Determined volume DB was empty at startup.
Jul 03 12:40:29 devstack cinder-volume[75503]: DEBUG cinder.volume.manager [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75503) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Jul 03 12:40:29 devstack cinder-volume[75503]: INFO cinder.volume.manager [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 03 12:40:29 devstack cinder-volume[75503]: WARNING stevedore.named [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 12:40:29 devstack cinder-volume[75503]: WARNING castellan.key_manager [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:40:29 devstack cinder-volume[75503]: WARNING cinder.keymgr.conf_key_mgr [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:40:29 devstack cinder-volume[75503]: DEBUG cinder.volume.drivers.lvm [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75503) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 03 12:40:29 devstack cinder-volume[75503]: DEBUG oslo_concurrency.processutils [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_concurrency.processutils [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] CMD "cinder-rtstool verify" returned: 0 in 0.437s {{(pid=75503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_db.sqlalchemy.engines [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75503) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:40:30 devstack cinder-volume[75503]: INFO cinder.rpc [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 03 12:40:30 devstack cinder-volume[75503]: INFO cinder.rpc [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 03 12:40:30 devstack cinder-volume[75503]: WARNING stevedore.named [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 12:40:30 devstack cinder-volume[75503]: WARNING castellan.key_manager [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:40:30 devstack cinder-volume[75503]: INFO cinder.volume.manager [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_db.sqlalchemy.engines [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75503) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:40:30 devstack cinder-volume[75503]: INFO oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Starting 1 workers
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Started child 75666 {{(pid=75503) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Full set of CONF: {{(pid=75503) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] ******************************************************************************** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Configuration options gathered from: {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] ================================================================================ {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] allow_availability_zone_fallback = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] allow_compression_on_image_upload = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] allowed_direct_url_schemes     = [] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] api_rate_limit                 = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] auth_strategy                  = keystone {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] az_cache_duration              = 3600 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_availability_zone      = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_host                   = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75666]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_name                   = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_stats_polling_interval = 60 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backup_api_class               = cinder.backup.api.API {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backup_name_template           = backup-%s {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backup_use_same_host           = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backup_use_temp_snapshot       = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] chap_password                  = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] chap_username                  =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cinder_internal_tenant_project_id = 35a0b4a474e74ae1830e264a5fec1eeb {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cinder_internal_tenant_user_id = 7393bf952c8342dc94e9524705b7584d {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cloned_volume_same_az          = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cluster                        = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] compression_format             = gzip {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] config_dir                     = [] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] config_source                  = [] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] control_exchange               = openstack {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] debug                          = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] default_availability_zone      = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] default_group_type             = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] default_volume_type            = lvmdriver-1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] disk_geometry                  = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] driver_client_cert             = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] driver_client_cert_key         = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] driver_data_namespace          = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] driver_ssl_cert_path           = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] driver_ssl_cert_verify         = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] driver_use_ssl                 = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] enable_force_upload            = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] enable_new_services            = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] enable_unsupported_driver      = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] enforce_multipath_for_image_xfer = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] filter_function                = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance_api_insecure            = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance_api_servers             = ['http://192.168.122.234/image'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance_api_ssl_compression     = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance_ca_certificates_file    = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance_certfile                = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance_keyfile                 = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance_num_retries             = 3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance_request_timeout         = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] goodness_function              = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] graceful_shutdown_timeout      = 5 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] group_api_class                = cinder.group.api.API {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] host                           = devstack {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] image_compress_on_upload       = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] image_conversion_address_space_limit = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] image_conversion_cpu_limit     = 60 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] image_conversion_disable       = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] image_upload_use_cinder_backend = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] image_upload_use_internal_tenant = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] image_volume_cache_enabled     = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] image_volume_cache_max_count   = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] image_volume_cache_max_size_gb = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] init_host_max_objects_retrieval = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] iscsi_target_flags             =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] iscsi_write_cache              = on {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] iser_helper                    = tgtadm {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75666]: INFO cinder.volume.manager [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] iser_ip_address                = 192.168.122.234 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] iser_port                      = 3260 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] log_color                      = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] log_config_append              = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] log_dir                        = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] log_file                       = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] log_options                    = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] log_rotate_interval            = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] log_rotate_interval_type       = days {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] log_rotation_type              = none {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] max_age                        = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] max_logfile_count              = 30 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] max_logfile_size_mb            = 200 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] max_over_subscription_ratio    = 20.0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] message_reap_interval          = 86400 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] message_ttl                    = 2592000 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] migration_create_volume_timeout_secs = 300 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] monkey_patch                   = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] monkey_patch_modules           = [] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] my_ip                          = 192.168.122.234 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] no_snapshot_gb_quota           = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] num_iser_scan_tries            = 3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] num_shell_tries                = 3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] num_volume_device_scan_tries   = 3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] nvmeof_conn_info_version       = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] nvmet_ns_id                    = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] nvmet_port_id                  = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] osapi_max_limit                = 1000 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] osapi_volume_ext_list          = [] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] osapi_volume_listen_port       = 8776 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] osapi_volume_use_ssl           = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] osapi_volume_workers           = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] per_volume_size_limit          = -1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] periodic_fuzzy_delay           = 60 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] periodic_interval              = 60 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] public_endpoint                = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] publish_errors                 = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] quota_backup_gigabytes         = 1000 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] quota_backups                  = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] quota_gigabytes                = 1000 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] quota_groups                   = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] quota_snapshots                = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] quota_volumes                  = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] rate_limit_burst               = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] rate_limit_except_level        = CRITICAL {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] rate_limit_interval            = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] reinit_driver_count            = 3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] replication_device             = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] report_discard_supported       = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] report_interval                = 120 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] reservation_clean_interval     = 86400 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] reservation_expire             = 86400 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] reserved_image_namespaces      = [] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] reserved_percentage            = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] rpc_response_timeout           = 120 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] run_external_periodic_tasks    = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] scst_target_driver             = iscsi {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] scst_target_iqn_name           = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] service_down_time              = 720 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] shell_completion               = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] snapshot_name_template         = snapshot-%s {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] snapshot_same_host             = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] split_loggers                  = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] state_path                     = /opt/stack/data/cinder {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] storage_availability_zone      = nova {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] storage_protocol               = iSCSI {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] syslog_log_facility            = LOG_USER {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] target_helper                  = lioadm {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] target_ip_address              = 192.168.122.234 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] target_port                    = 3260 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] target_protocol                = iscsi {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] target_secondary_ip_addresses  = [] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] trace_flags                    = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] transport_url                  = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] until_refresh                  = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] use_chap_auth                  = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] use_default_quota_class        = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] use_journal                    = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] use_json                       = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] use_multipath_for_image_xfer   = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] use_stderr                     = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] use_syslog                     = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] verify_glance_signatures       = enabled {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_api_class               = cinder.volume.api.API {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_backend_name            = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_clear                   = zero {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_clear_ionice            = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_clear_size              = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_copy_bps_limit          = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_dd_blocksize            = 1M {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_name_template           = volume-%s {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_service_inithost_offload = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volume_usage_audit_period      = month {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] zoning_mode                    = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_concurrency.disable_process_locking = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.auth_section = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.auth_type   = password {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.auth_version = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.cache       = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.certfile    = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.include_service_catalog = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.insecure    = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.interface   = public {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.keyfile     = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_password =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcache_username =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.region_name = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.service_type = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.234/identity {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.backend                  = dogpile.cache.null {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.backend_argument         = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.backend_expiration_time  = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.config_prefix            = cache.oslo {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.debug_cache_backend      = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.enable_retry_client      = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.enable_socket_keepalive  = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.enabled                  = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.expiration_time          = 600 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.hashclient_retry_attempts = 2 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.memcache_dead_retry      = 300 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.memcache_sasl_enabled    = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack sudo[75670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 03 12:40:30 devstack sudo[75670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.password                 = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.proxies                  = [] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.redis_db                 = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.redis_server             = localhost:6379 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.retry_attempts           = 2 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.retry_delay              = 0.0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.socket_keepalive_count   = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.socket_keepalive_idle    = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.socket_keepalive_interval = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.socket_timeout           = 1.0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.tls_allowed_ciphers      = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.tls_cafile               = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.tls_certfile             = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.tls_enabled              = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.tls_keyfile              = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cache.username                 = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] coordination.backend_url       = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.asyncio_connection    = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.asyncio_slave_connection = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.backend               = sqlalchemy {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.connection            = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.connection_debug      = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.connection_parameters =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.connection_recycle_time = 3600 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.connection_trace      = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.db_inc_retry_interval = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.db_max_retries        = 20 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.db_max_retry_interval = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.db_retry_interval     = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.max_overflow          = 50 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.max_pool_size         = 5 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.max_retries           = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.mysql_wsrep_sync_wait = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.pool_timeout          = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.retry_interval        = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.slave_connection      = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.sqlite_synchronous    = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.synchronous_reader    = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] database.use_db_reconnect      = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler.connection_string     = messaging:// {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler.enabled               = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler.es_doc_type           = notification {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler.es_scroll_size        = 10000 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler.es_scroll_time        = 2m {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler.filter_error_trace    = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler.hmac_keys             = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler.sentinel_service_name = mymaster {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler.socket_timeout        = 0.1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler.trace_requests        = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler.trace_sqlalchemy      = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler_jaeger.process_tags   = {} {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler_jaeger.service_name_prefix = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] profiler_otlp.service_name_prefix = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_policy.enforce_new_defaults = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_policy.enforce_scope      = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_policy.policy_default_rule = default {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] privsep_osbrick.group          = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] privsep_osbrick.helper_command = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] privsep_osbrick.user           = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cinder_sys_admin.group         = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cinder_sys_admin.helper_command = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] cinder_sys_admin.user          = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] service_user.auth_section      = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] service_user.auth_type         = password {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] service_user.cafile            = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] service_user.certfile          = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] service_user.collect_timing    = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] service_user.insecure          = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] service_user.keyfile           = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] service_user.send_service_user_token = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] service_user.split_loggers     = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] service_user.timeout           = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance.auth_section            = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance.auth_type               = password {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance.certfile                = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance.collect_timing          = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance.insecure                = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance.keyfile                 = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance.region_name             = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance.split_loggers           = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] glance.timeout                 = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.backend_availability_zone = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.chap_password = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.chap_username =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.disk_geometry = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.driver_client_cert = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.driver_client_cert_key = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.driver_data_namespace = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.driver_use_ssl = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.extra_capabilities = {} {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.filter_function = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.goodness_function = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.iscsi_target_flags =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.iscsi_write_cache = on {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.iser_ip_address = 192.168.122.234 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.iser_port     = 3260 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.lvm_share_target = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.lvm_type      = auto {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.num_shell_tries = 3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.replication_device = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.report_discard_supported = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.reserved_percentage = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.target_helper = tgtadm {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.target_ip_address = 192.168.122.234 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.target_port   = 3260 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.target_protocol = iscsi {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.trace_flags   = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.unique_fqdn_network = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.use_chap_auth = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.volume_backend_name = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.volume_clear  = zero {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.volume_clear_ionice = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.volume_clear_size = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_reports.file_event_handler = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_reports.log_dir           = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.backend_host       = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.chap_password      = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.chap_username      = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.disk_geometry      = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.driver_client_cert = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.extra_capabilities = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.filter_function    = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.goodness_function  = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.iser_helper        = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.iser_port          = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.lvm_type           = auto {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.replication_device = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.report_discard_supported = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.reserved_percentage = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.scst_target_driver = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.storage_protocol   = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.target_ip_address  = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.target_port        = 3260 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.trace_flags        = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.volume_clear       = zero {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] lvmdriver-1.volumes_dir        = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_notifications.driver = [] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_notifications.retry = -1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] key_manager.fixed_key          = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.barbican_api_version  = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.barbican_endpoint     = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.barbican_endpoint_type = public {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.barbican_region_name  = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.cafile                = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:30 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.certfile              = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.collect_timing        = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.insecure              = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.keyfile               = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.number_of_retries     = 60 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.retry_delay           = 1 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.send_service_user_token = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.split_loggers         = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.timeout               = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.verify_ssl            = True {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican.verify_ssl_path       = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican_service_user.auth_section = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican_service_user.auth_type = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican_service_user.cafile   = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican_service_user.certfile = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican_service_user.collect_timing = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican_service_user.insecure = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican_service_user.keyfile  = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican_service_user.split_loggers = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] barbican_service_user.timeout  = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vault.approle_role_id          = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vault.approle_secret_id        = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vault.kv_mountpoint            = secret {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vault.kv_path                  = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vault.kv_version               = 2 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vault.namespace                = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vault.root_token_id            = **** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vault.ssl_ca_crt_file          = None {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vault.timeout                  = 60.0 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vault.use_ssl                  = False {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:40:31 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] ******************************************************************************** {{(pid=75503) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 12:40:31 devstack sudo[75670]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:31 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.811s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:31 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:31 devstack sudo[75844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:40:31 devstack sudo[75844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:32 devstack sudo[75844]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:32 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.746s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:32 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 12:40:32 devstack cinder-volume[75666]: INFO cinder.brick.local_dev.lvm [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 03 12:40:32 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:32 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:32 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:32 devstack sudo[76091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:40:32 devstack sudo[76091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:33 devstack sudo[76091]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:33 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.870s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:33 devstack cinder-volume[75666]: DEBUG cinder.brick.local_dev.lvm [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75666) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 03 12:40:33 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:33 devstack sudo[76282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:40:33 devstack sudo[76282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:34 devstack sudo[76282]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:34 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.208s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:34 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:34 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:34 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:34 devstack sudo[76444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:40:34 devstack sudo[76444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:35 devstack sudo[76444]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:35 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.833s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:35 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:35 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:35 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:35 devstack sudo[76449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 03 12:40:35 devstack sudo[76449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:36 devstack sudo[76449]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:36 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.788s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:36 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:36 devstack sudo[76452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:40:36 devstack sudo[76452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:37 devstack sudo[76452]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:37 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.907s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:37 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:37 devstack sudo[76493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:40:37 devstack sudo[76493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:38 devstack sudo[76493]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:38 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.008s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:38 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:38 devstack sudo[76505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:40:38 devstack sudo[76505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:38 devstack sudo[76505]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:38 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.876s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:38 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:38 devstack sudo[76514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:40:38 devstack sudo[76514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:39 devstack sudo[76514]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:39 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.904s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:39 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:39 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:39 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:39 devstack sudo[76524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:40:39 devstack sudo[76524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:40 devstack sudo[76524]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:40 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.717s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:40 devstack cinder-volume[75666]: INFO cinder.volume.drivers.lvm [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 03 12:40:40 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:40 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:40 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:40 devstack sudo[76642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:40:40 devstack sudo[76642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:40 devstack cinder-volume[75503]: DEBUG dbcounter [-] [75503] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:40:41 devstack sudo[76642]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.758s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:41 devstack cinder-volume[75666]: DEBUG cinder.volume.drivers.lvm [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Updating volume stats {{(pid=75666) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:40:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:41 devstack sudo[76779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:40:41 devstack sudo[76779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:42 devstack sudo[76779]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.765s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:42 devstack sudo[76786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:40:42 devstack sudo[76786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:42 devstack sudo[76786]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.738s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:42 devstack sudo[76789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:40:42 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:43 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.699s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:43 devstack sudo[76793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:40:43 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:44 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:44 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:44 devstack cinder-volume[75666]: INFO cinder.volume.driver [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 12:40:44 devstack cinder-volume[75666]: DEBUG cinder.volume.driver [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75666) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Jul 03 12:40:44 devstack cinder-volume[75666]: DEBUG oslo_db.sqlalchemy.engines [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75666) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:40:44 devstack cinder-volume[75666]: DEBUG dbcounter [-] [75666] Writer thread running {{(pid=75666) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:40:44 devstack cinder-volume[75666]: DEBUG cinder.db.sqlalchemy.api [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Building query based on filter {{(pid=75666) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Jul 03 12:40:44 devstack cinder-volume[75666]: DEBUG cinder.image.image_utils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75666) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Jul 03 12:40:44 devstack cinder-volume[75666]: INFO cinder.keymgr.migration [None req-a81c3174-c24c-483e-be68-50d492db738f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 12:40:44 devstack cinder-volume[75666]: DEBUG cinder.volume.drivers.lvm [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Updating volume stats {{(pid=75666) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:40:44 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:44 devstack sudo[76800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:40:44 devstack sudo[76800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:45 devstack sudo[76800]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:45 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:45 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:45 devstack sudo[76803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:40:45 devstack sudo[76803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:45 devstack sudo[76803]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:45 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.734s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:45 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:45 devstack sudo[76806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:40:45 devstack sudo[76806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:46 devstack sudo[76806]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:46 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.761s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:46 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:46 devstack sudo[76811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:40:46 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:47 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:47 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:47 devstack cinder-volume[75666]: DEBUG cinder.manager [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Notifying Schedulers of capabilities ... {{(pid=75666) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:40:47 devstack cinder-volume[75666]: INFO cinder.volume.manager [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Driver initialization completed successfully.
Jul 03 12:40:47 devstack cinder-volume[75666]: INFO cinder.manager [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Initiating service 2 cleanup
Jul 03 12:40:47 devstack cinder-volume[75666]: INFO cinder.manager [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Service 2 cleanup completed.
Jul 03 12:40:47 devstack cinder-volume[75666]: DEBUG cinder.service [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Creating RPC server for service cinder-volume {{(pid=75666) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 12:40:47 devstack cinder-volume[75666]: DEBUG cinder.service [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75666) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 12:40:47 devstack cinder-volume[75666]: INFO cinder.volume.manager [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 03 12:40:47 devstack cinder-volume[75666]: DEBUG cinder.volume.drivers.lvm [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Updating volume stats {{(pid=75666) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:40:47 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:47 devstack sudo[76815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:40:47 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:48 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:48 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.768s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:48 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:48 devstack sudo[76821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:40:48 devstack sudo[76821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:48 devstack sudo[76821]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:48 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:48 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:48 devstack sudo[76879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:40:48 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:49 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:49 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:49 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:40:49 devstack sudo[76882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:40:49 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:40:50 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root
Jul 03 12:40:50 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:40:50 devstack cinder-volume[75666]: INFO cinder.volume.manager [None req-2cc63bf1-6d67-42c8-ac79-ac36435267e5 None None] Driver post RPC initialization completed successfully.
Jul 03 12:40:57 devstack cinder-volume[75666]: DEBUG dbcounter [-] [75666] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75666) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:41:00 devstack cinder-volume[75666]: DEBUG dbcounter [-] [75666] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=75666) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:41:41 devstack cinder-volume[75666]: DEBUG oslo_service.periodic_task [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75666) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:41:41 devstack cinder-volume[75666]: DEBUG cinder.volume.drivers.lvm [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Updating volume stats {{(pid=75666) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:41:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:41:41 devstack sudo[78496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:41:41 devstack sudo[78496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:41:42 devstack sudo[78496]: pam_unix(sudo:session): session closed for user root
Jul 03 12:41:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.812s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:41:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:41:42 devstack sudo[78499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:41:42 devstack sudo[78499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:41:42 devstack sudo[78499]: pam_unix(sudo:session): session closed for user root
Jul 03 12:41:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:41:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:41:42 devstack sudo[78542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:41:42 devstack sudo[78542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:41:43 devstack sudo[78542]: pam_unix(sudo:session): session closed for user root
Jul 03 12:41:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.717s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:41:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:41:43 devstack sudo[78545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:41:43 devstack sudo[78545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:41:44 devstack sudo[78545]: pam_unix(sudo:session): session closed for user root
Jul 03 12:41:44 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:41:44 devstack cinder-volume[75666]: DEBUG cinder.manager [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Notifying Schedulers of capabilities ... {{(pid=75666) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:42:41 devstack cinder-volume[75666]: DEBUG oslo_service.periodic_task [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75666) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:42:41 devstack cinder-volume[75666]: DEBUG cinder.volume.drivers.lvm [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Updating volume stats {{(pid=75666) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:42:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:42:41 devstack sudo[79228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:42:41 devstack sudo[79228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:42:41 devstack sudo[79228]: pam_unix(sudo:session): session closed for user root
Jul 03 12:42:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:42:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:42:42 devstack sudo[79231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:42:42 devstack sudo[79231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:42:42 devstack sudo[79231]: pam_unix(sudo:session): session closed for user root
Jul 03 12:42:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:42:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:42:42 devstack sudo[79234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:42:42 devstack sudo[79234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:42:43 devstack sudo[79234]: pam_unix(sudo:session): session closed for user root
Jul 03 12:42:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:42:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:42:43 devstack sudo[79238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:42:43 devstack sudo[79238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:42:44 devstack sudo[79238]: pam_unix(sudo:session): session closed for user root
Jul 03 12:42:44 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.717s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:42:44 devstack cinder-volume[75666]: DEBUG cinder.manager [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Notifying Schedulers of capabilities ... {{(pid=75666) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:43:00 devstack cinder-volume[75666]: DEBUG dbcounter [-] [75666] Writing DB stats cinder:SELECT=1 {{(pid=75666) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:43:00 devstack cinder-volume[75666]: DEBUG dbcounter [-] [75666] Writing DB stats cinder:UPDATE=1 {{(pid=75666) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:43:41 devstack cinder-volume[75666]: DEBUG oslo_service.periodic_task [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75666) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:43:41 devstack cinder-volume[75666]: DEBUG cinder.volume.drivers.lvm [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Updating volume stats {{(pid=75666) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:43:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:43:41 devstack sudo[82172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:43:41 devstack sudo[82172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:43:41 devstack sudo[82172]: pam_unix(sudo:session): session closed for user root
Jul 03 12:43:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:43:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:43:41 devstack sudo[82178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:43:41 devstack sudo[82178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:43:42 devstack sudo[82178]: pam_unix(sudo:session): session closed for user root
Jul 03 12:43:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.801s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:43:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:43:42 devstack sudo[82198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:43:42 devstack sudo[82198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:43:43 devstack sudo[82198]: pam_unix(sudo:session): session closed for user root
Jul 03 12:43:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.722s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:43:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:43:43 devstack sudo[82217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:43:43 devstack sudo[82217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:43:44 devstack sudo[82217]: pam_unix(sudo:session): session closed for user root
Jul 03 12:43:44 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:43:44 devstack cinder-volume[75666]: DEBUG cinder.manager [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Notifying Schedulers of capabilities ... {{(pid=75666) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:44:41 devstack cinder-volume[75666]: DEBUG oslo_service.periodic_task [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75666) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:44:41 devstack cinder-volume[75666]: DEBUG cinder.volume.drivers.lvm [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Updating volume stats {{(pid=75666) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:44:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:44:41 devstack sudo[84095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:44:41 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:44:42 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root
Jul 03 12:44:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.751s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:44:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:44:42 devstack sudo[84121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:44:42 devstack sudo[84121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:44:42 devstack sudo[84121]: pam_unix(sudo:session): session closed for user root
Jul 03 12:44:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.742s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:44:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:44:42 devstack sudo[84127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:44:42 devstack sudo[84127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:44:43 devstack sudo[84127]: pam_unix(sudo:session): session closed for user root
Jul 03 12:44:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.703s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:44:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:44:43 devstack sudo[84163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:44:43 devstack sudo[84163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:44:44 devstack sudo[84163]: pam_unix(sudo:session): session closed for user root
Jul 03 12:44:44 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:44:44 devstack cinder-volume[75666]: DEBUG cinder.manager [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Notifying Schedulers of capabilities ... {{(pid=75666) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:45:00 devstack cinder-volume[75666]: DEBUG dbcounter [-] [75666] Writing DB stats cinder:SELECT=1 {{(pid=75666) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:45:00 devstack cinder-volume[75666]: DEBUG dbcounter [-] [75666] Writing DB stats cinder:UPDATE=1 {{(pid=75666) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:45:41 devstack cinder-volume[75666]: DEBUG oslo_service.periodic_task [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75666) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:45:41 devstack cinder-volume[75666]: DEBUG cinder.volume.drivers.lvm [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Updating volume stats {{(pid=75666) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:45:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:45:41 devstack sudo[85291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:45:41 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:45:41 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root
Jul 03 12:45:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.706s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:45:41 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:45:42 devstack sudo[85308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:45:42 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:45:42 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root
Jul 03 12:45:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:45:42 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:45:42 devstack sudo[85317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:45:42 devstack sudo[85317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:45:43 devstack sudo[85317]: pam_unix(sudo:session): session closed for user root
Jul 03 12:45:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.711s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:45:43 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:45:43 devstack sudo[85321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:45:43 devstack sudo[85321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:45:44 devstack sudo[85321]: pam_unix(sudo:session): session closed for user root
Jul 03 12:45:44 devstack cinder-volume[75666]: DEBUG oslo_concurrency.processutils [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=75666) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:45:44 devstack cinder-volume[75666]: DEBUG cinder.manager [None req-c648e70b-abd0-4f29-905f-581cbcd198cc None None] Notifying Schedulers of capabilities ... {{(pid=75666) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:46:07 devstack cinder-volume[75503]: INFO oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Caught SIGTERM, stopping children
Jul 03 12:46:07 devstack cinder-volume[75503]: DEBUG oslo_concurrency.lockutils [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Acquiring lock "singleton_lock" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:46:07 devstack cinder-volume[75503]: DEBUG oslo_concurrency.lockutils [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Acquired lock "singleton_lock" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:46:07 devstack cinder-volume[75503]: DEBUG oslo_concurrency.lockutils [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Releasing lock "singleton_lock" {{(pid=75503) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:46:07 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Stop services. {{(pid=75503) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 03 12:46:07 devstack cinder-volume[75503]: DEBUG oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Killing children. {{(pid=75503) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 03 12:46:07 devstack cinder-volume[75503]: INFO oslo_service.backend._eventlet.service [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Waiting on 1 children to exit
Jul 03 12:46:12 devstack cinder-volume[75666]: DEBUG oslo_concurrency.lockutils [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Acquiring lock "singleton_lock" {{(pid=75666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:46:12 devstack cinder-volume[75666]: DEBUG oslo_concurrency.lockutils [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Acquired lock "singleton_lock" {{(pid=75666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:46:12 devstack cinder-volume[75666]: DEBUG oslo_concurrency.lockutils [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Releasing lock "singleton_lock" {{(pid=75666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:46:12 devstack cinder-volume[75666]: WARNING amqp [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 12:46:12 devstack cinder-volume[75666]: WARNING amqp [None req-be909baa-5cc2-4b0e-8c8d-4b9897f9e267 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 12:46:12 devstack cinder-volume[85865]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 12:46:12 devstack cinder-volume[85865]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 12:46:12 devstack cinder-volume[85865]: we strongly recommend against using it for new projects.
Jul 03 12:46:12 devstack cinder-volume[85865]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 12:46:12 devstack cinder-volume[85865]: framework.  For more detail see
Jul 03 12:46:12 devstack cinder-volume[85865]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 12:46:12 devstack cinder-volume[85865]:   import eventlet  # noqa
Jul 03 12:46:15 devstack cinder-volume[85865]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:46:15 devstack cinder-volume[85865]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:46:15 devstack cinder-volume[85865]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:46:15 devstack cinder-volume[85865]: INFO dbcounter [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Registered counter for database cinder
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_db.sqlalchemy.engines [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG dbcounter [-] [85865] Writer thread running {{(pid=85865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:46:16 devstack cinder-volume[85865]: INFO cinder.rpc [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 12:46:16 devstack cinder-volume[85865]: INFO cinder.rpc [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_db.sqlalchemy.engines [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:46:16 devstack cinder-volume[85865]: INFO cinder.volume.manager [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Determined volume DB was empty at startup.
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG cinder.volume.manager [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85865) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Jul 03 12:46:16 devstack cinder-volume[85865]: INFO cinder.volume.manager [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 03 12:46:16 devstack cinder-volume[85865]: WARNING stevedore.named [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 12:46:16 devstack cinder-volume[85865]: WARNING castellan.key_manager [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:46:16 devstack cinder-volume[85865]: WARNING cinder.keymgr.conf_key_mgr [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:46:16 devstack cinder-volume[85865]: INFO cinder.volume.manager [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_db.sqlalchemy.engines [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:46:16 devstack cinder-volume[85865]: INFO oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Starting 1 workers
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Started child 86081 {{(pid=85865) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Full set of CONF: {{(pid=85865) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] ******************************************************************************** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Configuration options gathered from: {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 12:46:16 devstack cinder-volume[86081]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] ================================================================================ {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] allow_availability_zone_fallback = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] allow_compression_on_image_upload = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] allowed_direct_url_schemes     = [] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] api_rate_limit                 = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] auth_strategy                  = keystone {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_availability_zone      = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_host                   = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_name                   = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_stats_polling_interval = 60 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backup_api_class               = cinder.backup.api.API {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backup_name_template           = backup-%s {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backup_use_same_host           = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backup_use_temp_snapshot       = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] chap_password                  = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] chap_username                  =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cinder_internal_tenant_project_id = 35a0b4a474e74ae1830e264a5fec1eeb {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cinder_internal_tenant_user_id = 7393bf952c8342dc94e9524705b7584d {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cluster                        = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] compression_format             = gzip {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] config_dir                     = [] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] config_source                  = [] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] control_exchange               = openstack {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] debug                          = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] default_availability_zone      = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] default_group_type             = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] default_volume_type            = QuobyteHD {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] disk_geometry                  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] driver_client_cert             = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] driver_client_cert_key         = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] driver_data_namespace          = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] driver_ssl_cert_path           = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] driver_ssl_cert_verify         = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] driver_use_ssl                 = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] enable_new_services            = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] enable_unsupported_driver      = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] enforce_multipath_for_image_xfer = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] filter_function                = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance_api_insecure            = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance_api_servers             = ['http://192.168.122.234/image'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance_api_ssl_compression     = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance_ca_certificates_file    = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance_certfile                = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance_keyfile                 = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance_num_retries             = 3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance_request_timeout         = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] goodness_function              = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] graceful_shutdown_timeout      = 5 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] group_api_class                = cinder.group.api.API {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] host                           = devstack {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] image_compress_on_upload       = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] image_conversion_address_space_limit = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] image_conversion_cpu_limit     = 60 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] image_conversion_disable       = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] image_upload_use_cinder_backend = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] image_upload_use_internal_tenant = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] image_volume_cache_enabled     = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] image_volume_cache_max_count   = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] image_volume_cache_max_size_gb = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] init_host_max_objects_retrieval = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] iscsi_target_flags             =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] iscsi_write_cache              = on {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] iser_helper                    = tgtadm {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] iser_ip_address                = 192.168.122.234 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] iser_port                      = 3260 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] log_color                      = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] log_config_append              = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] log_dir                        = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 03 12:46:16 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86081) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] log_file                       = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] log_options                    = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] log_rotate_interval            = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] log_rotate_interval_type       = days {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] log_rotation_type              = none {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] max_age                        = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] max_logfile_count              = 30 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] max_logfile_size_mb            = 200 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] max_over_subscription_ratio    = 20.0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] message_reap_interval          = 86400 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] message_ttl                    = 2592000 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] migration_create_volume_timeout_secs = 300 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] monkey_patch                   = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] monkey_patch_modules           = [] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] my_ip                          = 192.168.122.234 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] no_snapshot_gb_quota           = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] num_iser_scan_tries            = 3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] num_shell_tries                = 3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] num_volume_device_scan_tries   = 3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] nvmeof_conn_info_version       = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] nvmet_ns_id                    = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] nvmet_port_id                  = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] osapi_max_limit                = 1000 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] osapi_volume_ext_list          = [] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] osapi_volume_listen_port       = 8776 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] osapi_volume_use_ssl           = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] osapi_volume_workers           = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] per_volume_size_limit          = -1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] periodic_fuzzy_delay           = 60 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] periodic_interval              = 60 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] public_endpoint                = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] publish_errors                 = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] quota_backup_gigabytes         = 1000 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] quota_backups                  = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] quota_gigabytes                = 1000 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] quota_groups                   = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] quota_snapshots                = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] quota_volumes                  = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] rate_limit_burst               = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] rate_limit_except_level        = CRITICAL {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] rate_limit_interval            = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] reinit_driver_count            = 3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] replication_device             = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] report_discard_supported       = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] report_interval                = 120 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] reservation_clean_interval     = 86400 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] reservation_expire             = 86400 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] reserved_image_namespaces      = [] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] reserved_percentage            = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] rpc_response_timeout           = 120 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] run_external_periodic_tasks    = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] scst_target_driver             = iscsi {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] scst_target_iqn_name           = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] service_down_time              = 720 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] shell_completion               = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] snapshot_name_template         = snapshot-%s {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] split_loggers                  = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] state_path                     = /opt/stack/data/cinder {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] storage_availability_zone      = nova {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] storage_protocol               = iSCSI {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] syslog_log_facility            = LOG_USER {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] target_helper                  = lioadm {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] target_ip_address              = 192.168.122.234 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] target_port                    = 3260 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] target_protocol                = iscsi {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] target_secondary_ip_addresses  = [] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] trace_flags                    = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] transport_url                  = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] until_refresh                  = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] use_chap_auth                  = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] use_default_quota_class        = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] use_journal                    = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] use_json                       = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] use_multipath_for_image_xfer   = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] use_stderr                     = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] use_syslog                     = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] verify_glance_signatures       = enabled {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_api_class               = cinder.volume.api.API {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_backend_name            = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_clear                   = zero {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_clear_ionice            = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_clear_size              = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_copy_bps_limit          = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_dd_blocksize            = 1M {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_name_template           = volume-%s {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_service_inithost_offload = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volume_usage_audit_period      = month {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] zoning_mode                    = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_concurrency.disable_process_locking = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.auth_section = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.auth_type   = password {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.auth_version = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.cache       = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.certfile    = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.include_service_catalog = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.insecure    = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.interface   = public {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.keyfile     = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_password =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcache_username =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.region_name = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.service_type = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.234/identity {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.backend                  = dogpile.cache.null {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.backend_argument         = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.backend_expiration_time  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.config_prefix            = cache.oslo {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.debug_cache_backend      = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.enable_retry_client      = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.enable_socket_keepalive  = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.enabled                  = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.expiration_time          = 600 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.hashclient_retry_attempts = 2 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.memcache_dead_retry      = 300 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.memcache_sasl_enabled    = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.password                 = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.proxies                  = [] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.redis_db                 = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.redis_server             = localhost:6379 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.retry_attempts           = 2 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.retry_delay              = 0.0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.socket_keepalive_count   = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.socket_keepalive_idle    = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.socket_keepalive_interval = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.socket_timeout           = 1.0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.tls_allowed_ciphers      = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.tls_cafile               = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.tls_certfile             = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.tls_enabled              = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.tls_keyfile              = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cache.username                 = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] coordination.backend_url       = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.asyncio_connection    = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.asyncio_slave_connection = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.backend               = sqlalchemy {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.connection            = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.connection_debug      = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.connection_parameters =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.connection_recycle_time = 3600 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.connection_trace      = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.db_inc_retry_interval = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.db_max_retries        = 20 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.db_max_retry_interval = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.db_retry_interval     = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:16 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.max_overflow          = 50 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.max_pool_size         = 5 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.max_retries           = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.mysql_wsrep_sync_wait = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.pool_timeout          = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.retry_interval        = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.slave_connection      = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.sqlite_synchronous    = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.synchronous_reader    = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] database.use_db_reconnect      = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler.connection_string     = messaging:// {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler.enabled               = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler.es_doc_type           = notification {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler.es_scroll_size        = 10000 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler.es_scroll_time        = 2m {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler.filter_error_trace    = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler.hmac_keys             = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler.sentinel_service_name = mymaster {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler.socket_timeout        = 0.1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler.trace_requests        = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler.trace_sqlalchemy      = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler_jaeger.process_tags   = {} {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler_jaeger.service_name_prefix = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] profiler_otlp.service_name_prefix = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_policy.enforce_new_defaults = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_policy.enforce_scope      = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_policy.policy_default_rule = default {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] privsep_osbrick.group          = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] privsep_osbrick.helper_command = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] privsep_osbrick.user           = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cinder_sys_admin.group         = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cinder_sys_admin.helper_command = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] cinder_sys_admin.user          = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] service_user.auth_section      = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] service_user.auth_type         = password {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] service_user.cafile            = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] service_user.certfile          = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] service_user.collect_timing    = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] service_user.insecure          = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] service_user.keyfile           = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] service_user.send_service_user_token = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] service_user.split_loggers     = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] service_user.timeout           = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance.auth_section            = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance.auth_type               = password {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance.certfile                = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance.collect_timing          = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance.insecure                = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance.keyfile                 = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance.region_name             = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance.split_loggers           = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] glance.timeout                 = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.backend_availability_zone = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.chap_password = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.chap_username =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.disk_geometry = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.driver_client_cert = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.driver_client_cert_key = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.driver_data_namespace = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.driver_use_ssl = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.extra_capabilities = {} {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.filter_function = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.goodness_function = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86081) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.iscsi_target_flags =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.quobyte [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.iscsi_write_cache = on {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.quobyte [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.iser_ip_address = 192.168.122.234 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Running cmd (subprocess): mount.quobyte {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.iser_port     = 3260 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nas_host      =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nas_login     = admin {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nas_mount_options = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nas_password  = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nas_private_key =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nas_share_path =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.num_shell_tries = 3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.quobyte_volume_url = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.replication_device = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.report_discard_supported = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.reserved_percentage = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.target_helper = tgtadm {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.target_ip_address = 192.168.122.234 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.target_port   = 3260 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.target_protocol = iscsi {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.trace_flags   = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.unique_fqdn_network = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.use_chap_auth = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.volume_backend_name = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.volume_clear  = zero {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.volume_clear_ionice = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.volume_clear_size = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_reports.file_event_handler = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_reports.log_dir           = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.backend_availability_zone = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.backend_host         = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.chap_password        = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.chap_username        = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.disk_geometry        = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.driver_client_cert   = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.driver_data_namespace = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.extra_capabilities   = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.filter_function      = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.goodness_function    = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.iser_helper          = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.iser_ip_address      = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.iser_port            = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nas_host             = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nas_login            = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nas_mount_options    = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nas_password         = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nas_private_key      = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nas_share_path       = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.num_shell_tries      = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.replication_device   = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.report_discard_supported = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.reserved_percentage  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.scst_target_driver   = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.storage_protocol     = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.target_helper        = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.target_ip_address    = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.target_port          = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.target_prefix        = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.target_protocol      = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.trace_flags          = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.use_chap_auth        = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.volume_clear         = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.volume_clear_size    = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] QuobyteHD.volumes_dir          = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_notifications.driver = [] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_notifications.retry = -1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] key_manager.fixed_key          = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.barbican_api_version  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.barbican_endpoint     = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.barbican_endpoint_type = public {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.barbican_region_name  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.cafile                = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.certfile              = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.collect_timing        = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.insecure              = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.keyfile               = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.number_of_retries     = 60 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.retry_delay           = 1 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.send_service_user_token = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.split_loggers         = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.timeout               = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.verify_ssl            = True {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican.verify_ssl_path       = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican_service_user.auth_section = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican_service_user.auth_type = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican_service_user.cafile   = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican_service_user.certfile = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican_service_user.collect_timing = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican_service_user.insecure = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican_service_user.keyfile  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican_service_user.split_loggers = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] barbican_service_user.timeout  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vault.approle_role_id          = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vault.approle_secret_id        = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vault.kv_mountpoint            = secret {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vault.kv_path                  = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vault.kv_version               = 2 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vault.namespace                = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vault.root_token_id            = **** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vault.ssl_ca_crt_file          = None {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vault.timeout                  = 60.0 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vault.use_ssl                  = False {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:17 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] ******************************************************************************** {{(pid=85865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 12:46:17 devstack quobyte-client[86085]: Reading configuration file: /etc/quobyte/client.cfg
Jul 03 12:46:17 devstack quobyte-client[86085]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 03 12:46:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] CMD "mount.quobyte" returned: 1 in 0.117s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:46:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:46:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:46:17 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:46:17 devstack cinder-volume[86081]: INFO cinder.volume.drivers.quobyte [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 ...
Jul 03 12:46:17 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 -c /etc/quobyte/client-cinder.cfg {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:46:17 devstack sudo[86087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 -c /etc/quobyte/client-cinder.cfg
Jul 03 12:46:17 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:46:18 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root
Jul 03 12:46:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.929s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:46:18 devstack cinder-volume[86081]: INFO cinder.volume.drivers.quobyte [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 succeeded
Jul 03 12:46:18 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:46:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.954s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:46:18 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:46:18 devstack sudo[86160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:46:18 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:46:19 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.279s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:46:19 devstack cinder-volume[86081]: INFO cinder.volume.driver [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG cinder.volume.driver [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7087478637695, 'free_capacity_gb': 1775.7087478637695, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86081) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG oslo_db.sqlalchemy.engines [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writer thread running {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG cinder.db.sqlalchemy.api [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Building query based on filter {{(pid=86081) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86081) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Jul 03 12:46:19 devstack cinder-volume[86081]: INFO cinder.keymgr.migration [None req-c126658d-45a0-4c84-9b9b-47e0b6c0edea None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:46:19 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:46:19 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:46:19 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:46:20 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Jul 03 12:46:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.905s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:46:20 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:46:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Driver initialization completed successfully.
Jul 03 12:46:20 devstack cinder-volume[86081]: INFO cinder.manager [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Initiating service 3 cleanup
Jul 03 12:46:20 devstack cinder-volume[86081]: INFO cinder.manager [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Service 3 cleanup completed.
Jul 03 12:46:20 devstack cinder-volume[86081]: DEBUG cinder.service [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Creating RPC server for service cinder-volume {{(pid=86081) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 12:46:20 devstack cinder-volume[86081]: DEBUG cinder.service [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86081) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 12:46:20 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 03 12:46:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:46:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:46:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:46:20 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:46:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:46:20 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:46:20 devstack sudo[86311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:46:20 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:46:21 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root
Jul 03 12:46:21 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.930s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:46:21 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-a0df0af3-eec8-463c-a91a-a9af91f1d3ae None None] Driver post RPC initialization completed successfully.
Jul 03 12:46:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42d1bf73-2caa-440a-995d-c73e92b61f85 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:46:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42d1bf73-2caa-440a-995d-c73e92b61f85 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:46:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-42d1bf73-2caa-440a-995d-c73e92b61f85 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:46:23 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-42d1bf73-2caa-440a-995d-c73e92b61f85 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:46:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-42d1bf73-2caa-440a-995d-c73e92b61f85 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:46:23 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42d1bf73-2caa-440a-995d-c73e92b61f85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:46:23 devstack sudo[86385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:46:23 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:46:24 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root
Jul 03 12:46:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-42d1bf73-2caa-440a-995d-c73e92b61f85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.847s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:46:24 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-42d1bf73-2caa-440a-995d-c73e92b61f85 None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:46:24 devstack cinder-volume[85865]: INFO oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Caught SIGTERM, stopping children
Jul 03 12:46:24 devstack cinder-volume[85865]: DEBUG oslo_concurrency.lockutils [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Acquiring lock "singleton_lock" {{(pid=85865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:46:24 devstack cinder-volume[85865]: DEBUG oslo_concurrency.lockutils [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Acquired lock "singleton_lock" {{(pid=85865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:46:24 devstack cinder-volume[85865]: DEBUG oslo_concurrency.lockutils [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Releasing lock "singleton_lock" {{(pid=85865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:46:24 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Stop services. {{(pid=85865) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 03 12:46:24 devstack cinder-volume[85865]: DEBUG oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Killing children. {{(pid=85865) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 03 12:46:24 devstack cinder-volume[85865]: INFO oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Waiting on 1 children to exit
Jul 03 12:46:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Acquiring lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:46:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Acquired lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:46:24 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Releasing lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:46:24 devstack cinder-volume[86081]: WARNING amqp [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 12:46:24 devstack cinder-volume[86081]: WARNING amqp [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 12:46:24 devstack cinder-volume[85865]: INFO oslo_service.backend._eventlet.service [None req-dbb73c8b-27c1-4b6b-a106-f522a8766b61 None None] Child 86081 exited with status 0
Jul 03 12:46:25 devstack cinder-volume[86451]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 12:46:25 devstack cinder-volume[86451]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 12:46:25 devstack cinder-volume[86451]: we strongly recommend against using it for new projects.
Jul 03 12:46:25 devstack cinder-volume[86451]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 12:46:25 devstack cinder-volume[86451]: framework.  For more detail see
Jul 03 12:46:25 devstack cinder-volume[86451]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 12:46:25 devstack cinder-volume[86451]:   import eventlet  # noqa
Jul 03 12:46:28 devstack cinder-volume[86451]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86451) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:46:28 devstack cinder-volume[86451]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86451) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:46:28 devstack cinder-volume[86451]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86451) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:46:29 devstack cinder-volume[86451]: INFO dbcounter [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Registered counter for database cinder
Jul 03 12:46:29 devstack cinder-volume[86451]: DEBUG oslo_db.sqlalchemy.engines [None req-595d924b-af0b-4bdb-9424-452029beccca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86451) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:46:30 devstack cinder-volume[86451]: DEBUG dbcounter [-] [86451] Writer thread running {{(pid=86451) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:46:30 devstack cinder-volume[86451]: INFO cinder.rpc [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 12:46:30 devstack cinder-volume[86451]: INFO cinder.rpc [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 12:46:30 devstack cinder-volume[86451]: DEBUG oslo_db.sqlalchemy.engines [None req-595d924b-af0b-4bdb-9424-452029beccca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86451) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:46:30 devstack cinder-volume[86451]: INFO cinder.volume.manager [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Determined volume DB was empty at startup.
Jul 03 12:46:30 devstack cinder-volume[86451]: DEBUG cinder.volume.manager [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86451) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Jul 03 12:46:30 devstack cinder-volume[86451]: WARNING stevedore.named [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 12:46:30 devstack cinder-volume[86451]: WARNING castellan.key_manager [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:46:30 devstack cinder-volume[86451]: WARNING cinder.keymgr.conf_key_mgr [None req-595d924b-af0b-4bdb-9424-452029beccca None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:46:30 devstack cinder-volume[86451]: INFO cinder.volume.manager [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_db.sqlalchemy.engines [None req-595d924b-af0b-4bdb-9424-452029beccca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86451) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:46:31 devstack cinder-volume[86451]: INFO oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Starting 1 workers
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Started child 86763 {{(pid=86451) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 12:46:31 devstack cinder-volume[86763]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Full set of CONF: {{(pid=86451) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] ******************************************************************************** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] Configuration options gathered from: {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] ================================================================================ {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] allow_availability_zone_fallback = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] allow_compression_on_image_upload = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] allowed_direct_url_schemes     = [] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] api_rate_limit                 = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] auth_strategy                  = keystone {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_availability_zone      = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_host                   = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_name                   = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_stats_polling_interval = 60 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backup_api_class               = cinder.backup.api.API {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backup_name_template           = backup-%s {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backup_use_same_host           = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backup_use_temp_snapshot       = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] chap_password                  = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] chap_username                  =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cinder_internal_tenant_project_id = 35a0b4a474e74ae1830e264a5fec1eeb {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cinder_internal_tenant_user_id = 7393bf952c8342dc94e9524705b7584d {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cluster                        = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] compression_format             = gzip {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] compute_api_class              = cinder.compute.nova.API {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] config_dir                     = [] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] config_source                  = [] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] control_exchange               = openstack {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] debug                          = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] default_availability_zone      = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] default_group_type             = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] default_volume_type            = QuobyteHD {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] disk_geometry                  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] driver_client_cert             = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] driver_client_cert_key         = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] driver_data_namespace          = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] driver_ssl_cert_path           = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] driver_ssl_cert_verify         = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] driver_use_ssl                 = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] enable_new_services            = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] enable_unsupported_driver      = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] enabled_backends               = ['QuobyteHD'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] enforce_multipath_for_image_xfer = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] filter_function                = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance_api_insecure            = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance_api_servers             = ['http://192.168.122.234/image'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 03 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c1223590-21f3-4b34-811f-192509d48412 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86763) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance_api_ssl_compression     = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance_ca_certificates_file    = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance_catalog_info            = image:glance:publicURL {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance_certfile                = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance_keyfile                 = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance_num_retries             = 3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance_request_timeout         = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] goodness_function              = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] graceful_shutdown_timeout      = 5 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] group_api_class                = cinder.group.api.API {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] host                           = devstack {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] image_compress_on_upload       = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] image_conversion_address_space_limit = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] image_conversion_cpu_limit     = 60 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] image_conversion_disable       = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] image_upload_use_cinder_backend = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] image_upload_use_internal_tenant = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] image_volume_cache_enabled     = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] image_volume_cache_max_count   = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] image_volume_cache_max_size_gb = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] init_host_max_objects_retrieval = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] instance_format                = [instance: %(uuid)s]  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] iscsi_target_flags             =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] iscsi_write_cache              = on {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] iser_helper                    = tgtadm {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] iser_ip_address                = 192.168.122.234 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] iser_port                      = 3260 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] log_color                      = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] log_config_append              = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] log_dir                        = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] log_file                       = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] log_options                    = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] log_rotate_interval            = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] log_rotate_interval_type       = days {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] log_rotation_type              = none {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] max_age                        = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] max_logfile_count              = 30 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] max_logfile_size_mb            = 200 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] max_over_subscription_ratio    = 20.0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] message_reap_interval          = 86400 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] message_ttl                    = 2592000 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] migration_create_volume_timeout_secs = 300 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] monkey_patch                   = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] monkey_patch_modules           = [] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] my_ip                          = 192.168.122.234 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] no_snapshot_gb_quota           = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] num_iser_scan_tries            = 3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] num_shell_tries                = 3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] num_volume_device_scan_tries   = 3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] nvmeof_conn_info_version       = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] nvmet_ns_id                    = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] nvmet_port_id                  = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] osapi_max_limit                = 1000 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] osapi_volume_ext_list          = [] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] osapi_volume_listen_port       = 8776 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] osapi_volume_use_ssl           = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] osapi_volume_workers           = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] per_volume_size_limit          = -1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] periodic_fuzzy_delay           = 60 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] periodic_interval              = 60 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] public_endpoint                = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] publish_errors                 = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] quota_backup_gigabytes         = 1000 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] quota_backups                  = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] quota_gigabytes                = 1000 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] quota_groups                   = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] quota_snapshots                = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] quota_volumes                  = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] rate_limit_burst               = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] rate_limit_except_level        = CRITICAL {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] rate_limit_interval            = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] reinit_driver_count            = 3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] replication_device             = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] report_discard_supported       = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] report_interval                = 120 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] reservation_clean_interval     = 86400 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] reservation_expire             = 86400 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] reserved_image_namespaces      = [] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] reserved_percentage            = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] rpc_response_timeout           = 120 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] run_external_periodic_tasks    = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] scst_target_driver             = iscsi {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] scst_target_iqn_name           = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] service_down_time              = 720 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] shell_completion               = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] snapshot_name_template         = snapshot-%s {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] split_loggers                  = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] state_path                     = /opt/stack/data/cinder {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] storage_availability_zone      = nova {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] storage_protocol               = iSCSI {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] syslog_log_facility            = LOG_USER {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] target_helper                  = lioadm {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] target_ip_address              = 192.168.122.234 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] target_port                    = 3260 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] target_protocol                = iscsi {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] target_secondary_ip_addresses  = [] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] trace_flags                    = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] transport_url                  = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] until_refresh                  = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] use_chap_auth                  = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] use_default_quota_class        = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] use_journal                    = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] use_json                       = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] use_multipath_for_image_xfer   = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] use_stderr                     = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] use_syslog                     = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] verify_glance_signatures       = enabled {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_api_class               = cinder.volume.api.API {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_backend_name            = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_clear                   = zero {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_clear_ionice            = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_clear_size              = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_copy_bps_limit          = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_dd_blocksize            = 1M {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_name_template           = volume-%s {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_service_inithost_offload = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volume_usage_audit_period      = month {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] zoning_mode                    = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_concurrency.disable_process_locking = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.auth_section = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.auth_type   = password {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.auth_version = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.cache       = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1223590-21f3-4b34-811f-192509d48412 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86763) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 03 12:46:31 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.quobyte [None req-c1223590-21f3-4b34-811f-192509d48412 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 03 12:46:31 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.quobyte [None req-c1223590-21f3-4b34-811f-192509d48412 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.certfile    = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.delay_auth_decision = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.http_connect_timeout = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.include_service_catalog = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.insecure    = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.interface   = public {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.keyfile     = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_password =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Running cmd (subprocess): mount.quobyte {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcache_username =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.region_name = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.service_token_roles_required = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.service_type = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.token_cache_time = 300 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.234/identity {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.backend                  = dogpile.cache.null {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.backend_argument         = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.backend_expiration_time  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.config_prefix            = cache.oslo {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.debug_cache_backend      = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.enable_retry_client      = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.enable_socket_keepalive  = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.enabled                  = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.expiration_time          = 600 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.hashclient_retry_attempts = 2 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.memcache_dead_retry      = 300 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.memcache_pool_maxsize    = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.memcache_sasl_enabled    = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.password                 = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.proxies                  = [] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.redis_db                 = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.redis_sentinel_service_name = mymaster {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.redis_server             = localhost:6379 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.retry_attempts           = 2 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.retry_delay              = 0.0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.socket_keepalive_count   = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.socket_keepalive_idle    = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.socket_keepalive_interval = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.socket_timeout           = 1.0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.tls_allowed_ciphers      = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.tls_cafile               = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.tls_certfile             = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.tls_enabled              = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.tls_keyfile              = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cache.username                 = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] coordination.backend_url       = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.asyncio_connection    = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.asyncio_slave_connection = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.backend               = sqlalchemy {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.connection            = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.connection_debug      = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.connection_parameters =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.connection_recycle_time = 3600 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.connection_trace      = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.db_inc_retry_interval = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.db_max_retries        = 20 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.db_max_retry_interval = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.db_retry_interval     = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.max_overflow          = 50 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.max_pool_size         = 5 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.max_retries           = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.mysql_wsrep_sync_wait = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.pool_timeout          = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.retry_interval        = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.slave_connection      = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.sqlite_synchronous    = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.synchronous_reader    = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] database.use_db_reconnect      = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler.connection_string     = messaging:// {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler.enabled               = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler.es_doc_type           = notification {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler.es_scroll_size        = 10000 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler.es_scroll_time        = 2m {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler.filter_error_trace    = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler.hmac_keys             = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler.sentinel_service_name = mymaster {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler.socket_timeout        = 0.1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler.trace_requests        = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler.trace_sqlalchemy      = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler_jaeger.process_tags   = {} {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler_jaeger.service_name_prefix = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] profiler_otlp.service_name_prefix = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_policy.enforce_new_defaults = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_policy.enforce_scope      = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_policy.policy_default_rule = default {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_policy.policy_file        = policy.yaml {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] privsep_osbrick.group          = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] privsep_osbrick.helper_command = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] privsep_osbrick.user           = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cinder_sys_admin.group         = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cinder_sys_admin.helper_command = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] cinder_sys_admin.user          = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] service_user.auth_section      = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] service_user.auth_type         = password {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] service_user.cafile            = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] service_user.certfile          = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] service_user.collect_timing    = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] service_user.insecure          = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] service_user.keyfile           = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] service_user.send_service_user_token = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] service_user.split_loggers     = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] service_user.timeout           = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance.auth_section            = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack quobyte-client[86775]: Reading configuration file: /etc/quobyte/client.cfg
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance.auth_type               = password {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack quobyte-client[86775]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance.certfile                = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance.collect_timing          = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance.insecure                = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance.keyfile                 = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance.region_name             = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance.split_loggers           = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] glance.timeout                 = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.backend_availability_zone = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.chap_password = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.chap_username =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.disk_geometry = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.driver_client_cert = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.driver_client_cert_key = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.driver_data_namespace = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.driver_use_ssl = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] CMD "mount.quobyte" returned: 1 in 0.132s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.enable_unsupported_driver = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.extra_capabilities = {} {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.filter_function = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.goodness_function = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.iscsi_target_flags =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.iscsi_write_cache = on {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.iser_helper   = tgtadm {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.iser_ip_address = 192.168.122.234 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.iser_port     = 3260 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nas_host      =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nas_login     = admin {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nas_mount_options = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nas_password  = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nas_private_key =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nas_share_path =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.num_shell_tries = 3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.nvmet_port_id = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.quobyte_client_cfg = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.quobyte_volume_url = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.replication_device = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.report_discard_supported = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.reserved_percentage = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.scst_target_driver = iscsi {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.scst_target_iqn_name = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.storage_protocol = iSCSI {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.target_helper = tgtadm {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.target_ip_address = 192.168.122.234 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.target_port   = 3260 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.target_protocol = iscsi {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.trace_flags   = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.unique_fqdn_network = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.use_chap_auth = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.volume_backend_name = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.volume_clear  = zero {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.volume_clear_ionice = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.volume_clear_size = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_reports.file_event_handler = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_reports.log_dir           = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.backend_availability_zone = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.backend_host         = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.chap_password        = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.chap_username        = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.chiscsi_conf         = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.disk_geometry        = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.driver_client_cert   = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.driver_client_cert_key = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.driver_data_namespace = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.driver_use_ssl       = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.extra_capabilities   = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.filter_function      = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.goodness_function    = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.iser_helper          = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.iser_ip_address      = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.iser_port            = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.iser_target_prefix   = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nas_host             = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nas_login            = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nas_mount_options    = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nas_password         = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nas_private_key      = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nas_share_path       = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nas_ssh_port         = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.num_shell_tries      = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.nvmet_port_id        = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.replication_device   = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.report_discard_supported = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.reserved_percentage  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.scst_target_driver   = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack sudo[86785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.storage_protocol     = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.target_helper        = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.target_ip_address    = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.target_port          = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.target_prefix        = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.target_protocol      = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.trace_flags          = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.use_chap_auth        = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.volume_clear         = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.volume_clear_size    = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] QuobyteHD.volumes_dir          = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.ssl      = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_notifications.driver = [] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_notifications.retry = -1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] oslo_messaging_notifications.transport_url = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] key_manager.fixed_key          = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.barbican_api_version  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.barbican_endpoint     = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.barbican_endpoint_type = public {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.barbican_region_name  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.cafile                = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.certfile              = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.collect_timing        = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.insecure              = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.keyfile               = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.number_of_retries     = 60 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.retry_delay           = 1 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.send_service_user_token = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.split_loggers         = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.timeout               = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.verify_ssl            = True {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican.verify_ssl_path       = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican_service_user.auth_section = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican_service_user.auth_type = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican_service_user.cafile   = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican_service_user.certfile = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican_service_user.collect_timing = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican_service_user.insecure = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican_service_user.keyfile  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican_service_user.split_loggers = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] barbican_service_user.timeout  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vault.approle_role_id          = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vault.approle_secret_id        = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vault.kv_mountpoint            = secret {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vault.kv_path                  = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vault.kv_version               = 2 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vault.namespace                = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vault.root_token_id            = **** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vault.ssl_ca_crt_file          = None {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vault.timeout                  = 60.0 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vault.use_ssl                  = False {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:46:31 devstack cinder-volume[86451]: DEBUG oslo_service.backend._eventlet.service [None req-595d924b-af0b-4bdb-9424-452029beccca None None] ******************************************************************************** {{(pid=86451) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 12:46:32 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.006s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:46:32 devstack cinder-volume[86763]: INFO cinder.volume.driver [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.driver [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7313270568848, 'free_capacity_gb': 1775.7313270568848, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86763) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG oslo_db.sqlalchemy.engines [None req-c1223590-21f3-4b34-811f-192509d48412 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writer thread running {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.db.sqlalchemy.api [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Building query based on filter {{(pid=86763) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86763) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:46:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:46:32 devstack cinder-volume[86763]: INFO cinder.keymgr.migration [None req-208bf46b-53d1-46c6-ad5a-29ec2a497e1f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 12:46:32 devstack sudo[86815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:46:32 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.010s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:46:33 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root
Jul 03 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:46:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Driver initialization completed successfully.
Jul 03 12:46:33 devstack cinder-volume[86763]: INFO cinder.manager [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Initiating service 3 cleanup
Jul 03 12:46:33 devstack cinder-volume[86763]: INFO cinder.manager [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Service 3 cleanup completed.
Jul 03 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.service [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Creating RPC server for service cinder-volume {{(pid=86763) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.service [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86763) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 12:46:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 03 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:46:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:46:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:46:34 devstack sudo[86824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:46:34 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:46:34 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root
Jul 03 12:46:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c1223590-21f3-4b34-811f-192509d48412 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.019s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:46:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c1223590-21f3-4b34-811f-192509d48412 None None] Driver post RPC initialization completed successfully.
Jul 03 12:46:41 devstack cinder-volume[86451]: DEBUG dbcounter [-] [86451] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86451) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:46:43 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:46:44 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:48:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:48:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:05 devstack sudo[87454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:48:05 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:06 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.995s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Flow 'volume_create_manager' (e98602f7-2c36-4c46-994c-940592aff38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ced5994-ab4b-44d8-b3a1-44360e7d78dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ced5994-ab4b-44d8-b3a1-44360e7d78dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-273523661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af584500-067b-4ee4-8fc1-cf2f089a374c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b35e993c18f44f1848dd1743a9762b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:21Z,use_quota=True,user_id='d1885765a4c942d3bcd44e59a92f94db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c9f5a0-8809-479b-9e71-e716062c5138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c9f5a0-8809-479b-9e71-e716062c5138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed2fede-f089-4a69-a3f2-be3922164849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed2fede-f089-4a69-a3f2-be3922164849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af584500-067b-4ee4-8fc1-cf2f089a374c', 'volume_name': 'volume-af584500-067b-4ee4-8fc1-cf2f089a374c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3669c7-0298-47c7-a153-1cebfc1b1d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3669c7-0298-47c7-a153-1cebfc1b1d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a10010-5448-4ab5-a6d3-90347824aef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:21 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Volume af584500-067b-4ee4-8fc1-cf2f089a374c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af584500-067b-4ee4-8fc1-cf2f089a374c', 'volume_size': 1}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-273523661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af584500-067b-4ee4-8fc1-cf2f089a374c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b35e993c18f44f1848dd1743a9762b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:21Z,use_quota=True,user_id='d1885765a4c942d3bcd44e59a92f94db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Creating volume af584500-067b-4ee4-8fc1-cf2f089a374c {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:48:21 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:48:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:21 devstack sudo[87510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c 1073741824
Jul 03 12:48:21 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:23 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c 1073741824" returned: 0 in 2.246s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:23 devstack sudo[87830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c
Jul 03 12:48:23 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Flow 'volume_create_manager' (bc1f159a-e56c-46a1-bc23-471cc635d95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36bbbad2-cb43-4d49-a96b-8c9eab78b6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36bbbad2-cb43-4d49-a96b-8c9eab78b6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1039915982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554133d9-e91d-4a24-b464-40663e3319f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e2abfff2014d6aad52eb3a63a7fcea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:24Z,use_quota=True,user_id='2dff5406bce14e9bb9cd6d6441f3dfc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252108cb-7978-4c38-8dc6-5a64747e069d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252108cb-7978-4c38-8dc6-5a64747e069d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daab069a-8813-4303-bd97-00ea3df2b61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daab069a-8813-4303-bd97-00ea3df2b61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '554133d9-e91d-4a24-b464-40663e3319f3', 'volume_name': 'volume-554133d9-e91d-4a24-b464-40663e3319f3', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd275d21-c13b-4494-a467-10ceecf0466b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd275d21-c13b-4494-a467-10ceecf0466b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3192ae54-4bf6-404d-b7ed-20d6276e7092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:24 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Volume 554133d9-e91d-4a24-b464-40663e3319f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-554133d9-e91d-4a24-b464-40663e3319f3', 'volume_size': 1}
Jul 03 12:48:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:48:25 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c" returned: 0 in 1.253s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] <== create_volume: return (3647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.657s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1039915982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554133d9-e91d-4a24-b464-40663e3319f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e2abfff2014d6aad52eb3a63a7fcea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:24Z,use_quota=True,user_id='2dff5406bce14e9bb9cd6d6441f3dfc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Creating volume 554133d9-e91d-4a24-b464-40663e3319f3 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:48:25 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a10010-5448-4ab5-a6d3-90347824aef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af584500-067b-4ee4-8fc1-cf2f089a374c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa0387d-81f5-4678-86df-6387beab4a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:25 devstack sudo[87833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3 1073741824
Jul 03 12:48:25 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Volume volume-af584500-067b-4ee4-8fc1-cf2f089a374c (af584500-067b-4ee4-8fc1-cf2f089a374c): created successfully
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa0387d-81f5-4678-86df-6387beab4a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Flow 'volume_create_manager' (e98602f7-2c36-4c46-994c-940592aff38f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:48:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-89f3d228-0c0a-4df0-b14f-06ccf3fe702f tempest-DeleteServersTestJSON-1530129068 None] Created volume successfully.
Jul 03 12:48:26 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3 1073741824" returned: 0 in 1.875s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:27 devstack sudo[87851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3
Jul 03 12:48:27 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Flow 'volume_create_manager' (4a3b01e6-1fc8-4677-9c15-1601732576d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dff9ecb-e5c2-4139-a3fd-75442e367c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dff9ecb-e5c2-4139-a3fd-75442e367c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1224084391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3eda60a-3afe-472c-a9a3-ec7b2081df1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952fd3931f1443fe9f432920653accbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:27Z,use_quota=True,user_id='9aab5a8786504a628a008febc2f0aff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea9a201-9f83-4540-8b38-2a5d8b6d6158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea9a201-9f83-4540-8b38-2a5d8b6d6158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99deecd7-24b4-41e5-b0a0-6dd0ed630b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99deecd7-24b4-41e5-b0a0-6dd0ed630b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3eda60a-3afe-472c-a9a3-ec7b2081df1b', 'volume_name': 'volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee707dc5-7e56-4aee-9a39-9b1ba5fc2bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee707dc5-7e56-4aee-9a39-9b1ba5fc2bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad64dd0d-33df-443b-86f3-0d9e9c54ae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Volume b3eda60a-3afe-472c-a9a3-ec7b2081df1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b', 'volume_size': 1}
Jul 03 12:48:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:48:28 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3" returned: 0 in 1.357s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] <== create_volume: return (3428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.434s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1224084391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3eda60a-3afe-472c-a9a3-ec7b2081df1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952fd3931f1443fe9f432920653accbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:48:27Z,use_quota=True,user_id='9aab5a8786504a628a008febc2f0aff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Creating volume b3eda60a-3afe-472c-a9a3-ec7b2081df1b {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:48:28 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:28 devstack sudo[87854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b 1073741824
Jul 03 12:48:28 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3192ae54-4bf6-404d-b7ed-20d6276e7092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-554133d9-e91d-4a24-b464-40663e3319f3', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4064be58-dce4-4d1b-90c4-22f7d45ca254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Volume volume-554133d9-e91d-4a24-b464-40663e3319f3 (554133d9-e91d-4a24-b464-40663e3319f3): created successfully
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4064be58-dce4-4d1b-90c4-22f7d45ca254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Flow 'volume_create_manager' (bc1f159a-e56c-46a1-bc23-471cc635d95c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:48:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d047ee3d-bf9d-4c72-b98e-30b302d1f93d tempest-VolumesAdminNegativeTest-1195175979 None] Created volume successfully.
Jul 03 12:48:30 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b 1073741824" returned: 0 in 1.879s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:30 devstack sudo[87861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b
Jul 03 12:48:30 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Acquiring lock "cinder-554133d9-e91d-4a24-b464-40663e3319f3-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:48:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Lock "cinder-554133d9-e91d-4a24-b464-40663e3319f3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:48:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Acquiring lock "cinder-quobyte-554133d9-e91d-4a24-b464-40663e3319f3" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:48:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Lock "cinder-quobyte-554133d9-e91d-4a24-b464-40663e3319f3" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:48:31 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1ssx0j3l/privsep.sock']
Jul 03 12:48:31 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1ssx0j3l/privsep.sock
Jul 03 12:48:31 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:32 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b" returned: 0 in 2.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] <== create_volume: return (4276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:48:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.287s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:48:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad64dd0d-33df-443b-86f3-0d9e9c54ae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d92a186-839b-4f43-b321-72433823d684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:48:32 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 03 12:48:32 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 12:48:32 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 03 12:48:32 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 12:48:32 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 03 12:48:32 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 03 12:48:32 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 12:48:32 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 12:48:32 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 03 12:48:32 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Volume volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b (b3eda60a-3afe-472c-a9a3-ec7b2081df1b): created successfully
Jul 03 12:48:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d92a186-839b-4f43-b321-72433823d684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:48:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Flow 'volume_create_manager' (4a3b01e6-1fc8-4677-9c15-1601732576d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:48:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b3bcac15-770f-4690-912c-27750fd386c9 tempest-AttachVolumeTestJSON-58977977 None] Created volume successfully.
Jul 03 12:48:34 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 03 12:48:34 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 12:48:34 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 03 12:48:34 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 12:48:34 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 03 12:48:34 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 03 12:48:34 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 12:48:34 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 12:48:34 devstack cinder-volume[86763]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 03 12:48:35 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:36 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Spawned new privsep daemon via rootwrap
Jul 03 12:48:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Accepted privsep connection to /tmp/tmp1ssx0j3l/privsep.sock {{(pid=86763) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 03 12:48:36 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 03 12:48:36 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 03 12:48:36 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 03 12:48:36 devstack cinder-volume[86763]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87889
Jul 03 12:48:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[543dde33-2e93-42fd-aa04-2881307a8e11]: (2,) {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:48:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9249bb74-36f2-4222-bd4c-8283216afe14]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:48:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:36 devstack sudo[87914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3
Jul 03 12:48:36 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:37 devstack cinder-volume[86763]: WARNING py.warnings [req-db55c4ba-897c-4570-9151-25b0b86d54f6 req-41446cca-41be-43af-8e42-446c2b9b364a tempest-DeleteServersTestJSON-1530129068 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Jul 03 12:48:37 devstack cinder-volume[86763]:   .first()
Jul 03 12:48:37 devstack cinder-volume[86763]: 
Jul 03 12:48:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-db55c4ba-897c-4570-9151-25b0b86d54f6 req-41446cca-41be-43af-8e42-446c2b9b364a tempest-DeleteServersTestJSON-1530129068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:48:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-db55c4ba-897c-4570-9151-25b0b86d54f6 req-41446cca-41be-43af-8e42-446c2b9b364a tempest-DeleteServersTestJSON-1530129068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:48:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecfd715-f958-45b1-bfd7-8f2eb4c487ac]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:48:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-db55c4ba-897c-4570-9151-25b0b86d54f6 req-41446cca-41be-43af-8e42-446c2b9b364a tempest-DeleteServersTestJSON-1530129068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:37 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c
Jul 03 12:48:37 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:38 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3" returned: 0 in 1.987s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:38 devstack sudo[87975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3
Jul 03 12:48:38 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-04d1bc08-dcf6-4f52-b4aa-13aa66f48dad req-49e0ed82-c03b-4509-8949-13448cc6ebc5 tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:48:39 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-db55c4ba-897c-4570-9151-25b0b86d54f6 req-41446cca-41be-43af-8e42-446c2b9b364a tempest-DeleteServersTestJSON-1530129068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c" returned: 0 in 1.833s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-db55c4ba-897c-4570-9151-25b0b86d54f6 req-41446cca-41be-43af-8e42-446c2b9b364a tempest-DeleteServersTestJSON-1530129068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.874s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:48:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-04d1bc08-dcf6-4f52-b4aa-13aa66f48dad req-49e0ed82-c03b-4509-8949-13448cc6ebc5 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.242s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:48:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[049548b4-c0d4-4561-88f0-cc210cc3c214]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:48:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-04d1bc08-dcf6-4f52-b4aa-13aa66f48dad req-49e0ed82-c03b-4509-8949-13448cc6ebc5 tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-db55c4ba-897c-4570-9151-25b0b86d54f6 req-41446cca-41be-43af-8e42-446c2b9b364a tempest-DeleteServersTestJSON-1530129068 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-af584500-067b-4ee4-8fc1-cf2f089a374c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '483415c4-fe44-4bbe-99ef-2e2033f30af2', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:48:39 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-554133d9-e91d-4a24-b464-40663e3319f3" returned: 0 in 1.476s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:39 devstack sudo[87991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b
Jul 03 12:48:39 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Lock "cinder-quobyte-554133d9-e91d-4a24-b464-40663e3319f3" released by "delete_volume" :: held 8.000s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:48:39 devstack cinder-volume[86763]: WARNING cinder.quota [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:48:39 devstack cinder-volume[86763]: WARNING cinder.quota [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:48:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Created reservations ['d496ee36-a8a7-45e5-acfd-6215ea232234', '406bbdb6-c178-428a-8236-7b007b3dc088', '534203bb-ac50-4b0a-a065-6a5cee4608ea', '3c4fe61e-35c1-40b5-933c-04afe783862e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:48:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-db55c4ba-897c-4570-9151-25b0b86d54f6 req-41446cca-41be-43af-8e42-446c2b9b364a tempest-DeleteServersTestJSON-1530129068 None] attachment_update completed successfully.
Jul 03 12:48:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:48:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:48:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:48:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:48:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:48:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:40 devstack sudo[87994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:48:40 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:40 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-04d1bc08-dcf6-4f52-b4aa-13aa66f48dad req-49e0ed82-c03b-4509-8949-13448cc6ebc5 tempest-AttachVolumeTestJSON-58977977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b" returned: 0 in 1.343s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-04d1bc08-dcf6-4f52-b4aa-13aa66f48dad req-49e0ed82-c03b-4509-8949-13448cc6ebc5 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.413s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:48:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-04d1bc08-dcf6-4f52-b4aa-13aa66f48dad req-49e0ed82-c03b-4509-8949-13448cc6ebc5 tempest-AttachVolumeTestJSON-58977977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06b83f32-1ead-498a-bf12-cd2ac2fbf57c', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:48:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-04d1bc08-dcf6-4f52-b4aa-13aa66f48dad req-49e0ed82-c03b-4509-8949-13448cc6ebc5 tempest-AttachVolumeTestJSON-58977977 None] attachment_update completed successfully.
Jul 03 12:48:41 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.552s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:41 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:48:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Deleted volume successfully.
Jul 03 12:48:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a0f14eda-9670-4b3f-9d47-282d26a66bfd tempest-VolumesAdminNegativeTest-1195175979 None] Lock "cinder-554133d9-e91d-4a24-b464-40663e3319f3-delete_volume" released by "delete_volume" :: held 10.220s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:48:51 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=24,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:48:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-6f1871c2-8f1b-4bae-9dbf-5fda8eda1cdd req-46f51521-cbd2-42ef-bd99-b5ae1f6af1eb tempest-DeleteServersTestJSON-1530129068 None] Terminate volume connection completed successfully.
Jul 03 12:48:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-6f1871c2-8f1b-4bae-9dbf-5fda8eda1cdd req-46f51521-cbd2-42ef-bd99-b5ae1f6af1eb tempest-DeleteServersTestJSON-1530129068 None] Deleting attachment 483415c4-fe44-4bbe-99ef-2e2033f30af2. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:48:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Acquiring lock "cinder-af584500-067b-4ee4-8fc1-cf2f089a374c-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:48:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Lock "cinder-af584500-067b-4ee4-8fc1-cf2f089a374c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:48:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Acquiring lock "cinder-quobyte-af584500-067b-4ee4-8fc1-cf2f089a374c" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:48:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Lock "cinder-quobyte-af584500-067b-4ee4-8fc1-cf2f089a374c" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:48:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fe0895-2afc-45a9-b71a-76beb4c5f060]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:48:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:55 devstack sudo[88550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c
Jul 03 12:48:55 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:56 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c" returned: 0 in 1.195s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:57 devstack sudo[88555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c
Jul 03 12:48:57 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:57 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af584500-067b-4ee4-8fc1-cf2f089a374c" returned: 0 in 0.911s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Lock "cinder-quobyte-af584500-067b-4ee4-8fc1-cf2f089a374c" released by "delete_volume" :: held 2.169s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:48:57 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Created reservations ['dfcb54a3-5c37-4480-a883-206d9da11ed2', '64047e75-df0b-4c32-8576-f8b3b4dfa2cc', '62433c97-9017-4089-9660-f75f66d41370', '8638a6de-19ec-4781-804e-6ecae7937fcc'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:48:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:48:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:48:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:48:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:48:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:48:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:48:58 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:48:58 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:48:58 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Jul 03 12:48:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.882s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:48:58 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:48:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Deleted volume successfully.
Jul 03 12:48:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bd708dee-93c4-4a61-8f94-09934c3ab110 tempest-DeleteServersTestJSON-1530129068 None] Lock "cinder-af584500-067b-4ee4-8fc1-cf2f089a374c-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:49:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:49:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:49:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:49:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:49:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:49:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:49:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:49:05 devstack sudo[88602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:49:05 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:49:05 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root
Jul 03 12:49:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.951s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:49:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:49:08 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:49:08 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=25,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:49:10 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:49:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Flow 'volume_create_manager' (5209890e-e678-40a2-8b7c-06f5cdff8c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:49:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bf99b0-5c61-4bec-ad21-d39f4497fd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:49:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bf99b0-5c61-4bec-ad21-d39f4497fd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1426656485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782b4ada-322d-4c53-806f-a78ed05644b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3391a7e9b24b4ee583430de171bcc6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:11Z,use_quota=True,user_id='0929b9e275f84e6fbe2baa4ab506dc2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ecf8e2-ca62-4b20-a900-9649779f0a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ecf8e2-ca62-4b20-a900-9649779f0a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a6d849-a70c-47c5-8c44-df160c49f187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a6d849-a70c-47c5-8c44-df160c49f187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782b4ada-322d-4c53-806f-a78ed05644b5', 'volume_name': 'volume-782b4ada-322d-4c53-806f-a78ed05644b5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50e3386-0573-423f-aaaf-36054f829a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50e3386-0573-423f-aaaf-36054f829a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8dd453-0bbb-417f-a426-8f4d1720fd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:49:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Volume 782b4ada-322d-4c53-806f-a78ed05644b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782b4ada-322d-4c53-806f-a78ed05644b5', 'volume_size': 1}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1426656485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782b4ada-322d-4c53-806f-a78ed05644b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3391a7e9b24b4ee583430de171bcc6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:49:11Z,use_quota=True,user_id='0929b9e275f84e6fbe2baa4ab506dc2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Creating volume 782b4ada-322d-4c53-806f-a78ed05644b5 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:49:11 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:49:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:49:11 devstack sudo[88687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5 1073741824
Jul 03 12:49:11 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:49:12 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root
Jul 03 12:49:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5 1073741824" returned: 0 in 1.841s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:49:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:49:13 devstack sudo[89073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5
Jul 03 12:49:13 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:49:14 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root
Jul 03 12:49:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5" returned: 0 in 1.310s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:49:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] <== create_volume: return (3253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:49:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.256s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:49:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8dd453-0bbb-417f-a426-8f4d1720fd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782b4ada-322d-4c53-806f-a78ed05644b5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:49:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d53089-c2aa-403f-8c07-4a73b1c27a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:49:14 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Volume volume-782b4ada-322d-4c53-806f-a78ed05644b5 (782b4ada-322d-4c53-806f-a78ed05644b5): created successfully
Jul 03 12:49:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d53089-c2aa-403f-8c07-4a73b1c27a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:49:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Flow 'volume_create_manager' (5209890e-e678-40a2-8b7c-06f5cdff8c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:49:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9261fa5c-e3ce-4f35-a8bc-1e6a45f79970 tempest-TaggedAttachmentsTest-2105322331 None] Created volume successfully.
Jul 03 12:49:24 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:49:24 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:49:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-106373b3-41c4-4a20-8ae0-7c543fddf1a9 req-d9bcd359-04e1-489b-a8aa-d7abde133669 tempest-AttachVolumeTestJSON-58977977 None] Terminate volume connection completed successfully.
Jul 03 12:49:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-106373b3-41c4-4a20-8ae0-7c543fddf1a9 req-d9bcd359-04e1-489b-a8aa-d7abde133669 tempest-AttachVolumeTestJSON-58977977 None] Deleting attachment 06b83f32-1ead-498a-bf12-cd2ac2fbf57c. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:49:49 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:49:49 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:50:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:50:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:50:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:50:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:50:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:50:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:50:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:05 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:50:05 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:07 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 2.648s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:07 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Flow 'volume_create_manager' (1e2b5039-0fe6-4408-9911-86e3d019becf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de148b60-f5e3-409d-ab99-46c5d37edcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de148b60-f5e3-409d-ab99-46c5d37edcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1955097610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab895ee-0e11-4da3-8239-0f7b8b1b00d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a8c28ee33ec44b4891dafd201f3f29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:28Z,use_quota=True,user_id='081c7c0c7bea48c6b02653382b3134e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff7999d-aa75-46bf-bab5-1ce4c4fe2b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff7999d-aa75-46bf-bab5-1ce4c4fe2b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031de8ad-7e44-4c35-99bd-cbd4af26d656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031de8ad-7e44-4c35-99bd-cbd4af26d656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab895ee-0e11-4da3-8239-0f7b8b1b00d1', 'volume_name': 'volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759d5548-bbfd-459b-a120-f8e934191b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759d5548-bbfd-459b-a120-f8e934191b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005dc5b7-9af3-4537-bf3e-1728da8f3568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Volume bab895ee-0e11-4da3-8239-0f7b8b1b00d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1', 'volume_size': 1}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1955097610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab895ee-0e11-4da3-8239-0f7b8b1b00d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a8c28ee33ec44b4891dafd201f3f29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:28Z,use_quota=True,user_id='081c7c0c7bea48c6b02653382b3134e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Creating volume bab895ee-0e11-4da3-8239-0f7b8b1b00d1 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:50:28 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:50:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:28 devstack sudo[90029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1 1073741824
Jul 03 12:50:28 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:30 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1 1073741824" returned: 0 in 1.615s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:30 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1
Jul 03 12:50:30 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:50:31 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Flow 'volume_create_manager' (f2caf8d7-b4c7-48ea-8a11-0c9ea938e319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5144ce-e02e-4ee1-a4f8-82e39684080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1" returned: 0 in 1.419s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] <== create_volume: return (3102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.105s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5144ce-e02e-4ee1-a4f8-82e39684080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2100384260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf984b8-5842-4198-90a8-decd1728e5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f676baae8ee34b04840068744e4b963d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:31Z,use_quota=True,user_id='6e46d89baf714feabf5350d76ba01829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcc09c5-7d46-4e6d-9944-07da0ba1ff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcc09c5-7d46-4e6d-9944-07da0ba1ff58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68235021-7739-4e49-a54e-7e22465ece65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68235021-7739-4e49-a54e-7e22465ece65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf984b8-5842-4198-90a8-decd1728e5b5', 'volume_name': 'volume-4bf984b8-5842-4198-90a8-decd1728e5b5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37adfc16-c731-4bf7-8f5b-f15ec73e4b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37adfc16-c731-4bf7-8f5b-f15ec73e4b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988222a8-e83d-4e36-9762-4759d2f54528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Volume 4bf984b8-5842-4198-90a8-decd1728e5b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf984b8-5842-4198-90a8-decd1728e5b5', 'volume_size': 1}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2100384260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf984b8-5842-4198-90a8-decd1728e5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f676baae8ee34b04840068744e4b963d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:50:31Z,use_quota=True,user_id='6e46d89baf714feabf5350d76ba01829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Creating volume 4bf984b8-5842-4198-90a8-decd1728e5b5 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:50:31 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005dc5b7-9af3-4537-bf3e-1728da8f3568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:31 devstack sudo[90093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5 1073741824
Jul 03 12:50:31 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc2db04-7d00-40d9-8865-e34db30bad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Volume volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1 (bab895ee-0e11-4da3-8239-0f7b8b1b00d1): created successfully
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc2db04-7d00-40d9-8865-e34db30bad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Flow 'volume_create_manager' (1e2b5039-0fe6-4408-9911-86e3d019becf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:50:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-36fd2a18-4b8c-40c4-a1c1-ed9fa222e9e4 tempest-ServerRescueNegativeTestJSON-575122183 None] Created volume successfully.
Jul 03 12:50:32 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5 1073741824" returned: 0 in 1.324s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:33 devstack sudo[90101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5
Jul 03 12:50:33 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:33 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5" returned: 0 in 0.907s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] <== create_volume: return (2313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:50:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.316s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:50:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988222a8-e83d-4e36-9762-4759d2f54528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf984b8-5842-4198-90a8-decd1728e5b5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c18d5d-2ea3-4842-ab25-320930b59185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:50:33 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Volume volume-4bf984b8-5842-4198-90a8-decd1728e5b5 (4bf984b8-5842-4198-90a8-decd1728e5b5): created successfully
Jul 03 12:50:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c18d5d-2ea3-4842-ab25-320930b59185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:50:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Flow 'volume_create_manager' (f2caf8d7-b4c7-48ea-8a11-0c9ea938e319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:50:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b62ac57d-4aaf-4f4a-b183-c6533f74a54d tempest-AttachVolumeShelveTestJSON-913854302 None] Created volume successfully.
Jul 03 12:50:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-773d82dd-bdf5-45cc-9d29-bf113962a3c1 req-c49effe0-4e02-49fd-a9e1-39052f6f5839 tempest-TaggedAttachmentsTest-2105322331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:50:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-773d82dd-bdf5-45cc-9d29-bf113962a3c1 req-c49effe0-4e02-49fd-a9e1-39052f6f5839 tempest-TaggedAttachmentsTest-2105322331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:50:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d42f771-1d09-4c23-986c-dc358cf81610]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:50:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-773d82dd-bdf5-45cc-9d29-bf113962a3c1 req-c49effe0-4e02-49fd-a9e1-39052f6f5839 tempest-TaggedAttachmentsTest-2105322331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:36 devstack sudo[90123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5
Jul 03 12:50:36 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:37 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-773d82dd-bdf5-45cc-9d29-bf113962a3c1 req-c49effe0-4e02-49fd-a9e1-39052f6f5839 tempest-TaggedAttachmentsTest-2105322331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5" returned: 0 in 1.329s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-773d82dd-bdf5-45cc-9d29-bf113962a3c1 req-c49effe0-4e02-49fd-a9e1-39052f6f5839 tempest-TaggedAttachmentsTest-2105322331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.364s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:50:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-773d82dd-bdf5-45cc-9d29-bf113962a3c1 req-c49effe0-4e02-49fd-a9e1-39052f6f5839 tempest-TaggedAttachmentsTest-2105322331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-782b4ada-322d-4c53-806f-a78ed05644b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9720e0c3-cff4-4053-8343-a504df2e3d98', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:50:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-773d82dd-bdf5-45cc-9d29-bf113962a3c1 req-c49effe0-4e02-49fd-a9e1-39052f6f5839 tempest-TaggedAttachmentsTest-2105322331 None] attachment_update completed successfully.
Jul 03 12:50:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-1621a590-a89d-4283-8f5c-04d52d1775b2 req-ae5bb604-d2e6-4efb-ab64-dda73eedcc39 tempest-TaggedAttachmentsTest-2105322331 None] Terminate volume connection completed successfully.
Jul 03 12:50:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-1621a590-a89d-4283-8f5c-04d52d1775b2 req-ae5bb604-d2e6-4efb-ab64-dda73eedcc39 tempest-TaggedAttachmentsTest-2105322331 None] Deleting attachment 9720e0c3-cff4-4053-8343-a504df2e3d98. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:50:48 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Acquiring lock "cinder-bab895ee-0e11-4da3-8239-0f7b8b1b00d1-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Lock "cinder-bab895ee-0e11-4da3-8239-0f7b8b1b00d1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Acquiring lock "cinder-quobyte-bab895ee-0e11-4da3-8239-0f7b8b1b00d1" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:50:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Lock "cinder-quobyte-bab895ee-0e11-4da3-8239-0f7b8b1b00d1" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:50:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f425492b-0688-4dfc-84ac-3a3cdd7ade25]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:50:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:54 devstack sudo[91031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1
Jul 03 12:50:54 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:56 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1" returned: 0 in 1.651s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:56 devstack sudo[91041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1
Jul 03 12:50:56 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:57 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bab895ee-0e11-4da3-8239-0f7b8b1b00d1" returned: 0 in 0.877s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Lock "cinder-quobyte-bab895ee-0e11-4da3-8239-0f7b8b1b00d1" released by "delete_volume" :: held 2.591s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:50:57 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Created reservations ['af9cc2d1-9e8d-4249-ae1c-1ce3a65b2c2f', 'd14707fd-73e6-48b3-92a0-0141c18d946a', '291b1659-3cad-4898-850f-eb184cfa51b2', '1c7a4ecf-5a66-4406-8d44-ebf25209d296'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:50:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:50:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:50:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:50:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:50:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:50:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:57 devstack sudo[91046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:50:57 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:58 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.198s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:58 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:50:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Deleted volume successfully.
Jul 03 12:50:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f81918ab-d96f-4e2d-b87c-86b4c82d0b84 tempest-ServerRescueNegativeTestJSON-575122183 None] Lock "cinder-bab895ee-0e11-4da3-8239-0f7b8b1b00d1-delete_volume" released by "delete_volume" :: held 4.138s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:51:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-c67e0e87-1963-431b-98ab-1e47805e3a46 req-a677c93d-df5e-4f47-9814-91f872fa5d98 tempest-AttachVolumeShelveTestJSON-913854302 None] No connector for attachment 5ce53d81-ae20-4f32-b234-b0d6d08d2829; skipping storage backend terminate_connection call. {{(pid=86763) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 03 12:51:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-c67e0e87-1963-431b-98ab-1e47805e3a46 req-a677c93d-df5e-4f47-9814-91f872fa5d98 tempest-AttachVolumeShelveTestJSON-913854302 None] Deleting attachment 5ce53d81-ae20-4f32-b234-b0d6d08d2829. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:51:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:51:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:51:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:51:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:51:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:51:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:51:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:05 devstack sudo[91157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:51:05 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:06 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.180s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:51:08 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:51:11 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=22,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:51:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Acquiring lock "cinder-782b4ada-322d-4c53-806f-a78ed05644b5-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:51:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Lock "cinder-782b4ada-322d-4c53-806f-a78ed05644b5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:51:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Acquiring lock "cinder-quobyte-782b4ada-322d-4c53-806f-a78ed05644b5" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:51:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Lock "cinder-quobyte-782b4ada-322d-4c53-806f-a78ed05644b5" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:51:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3792431f-4715-4a34-8b01-26332d66a7b2]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:51:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:12 devstack sudo[91277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5
Jul 03 12:51:12 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:13 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5" returned: 0 in 0.991s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:13 devstack sudo[91282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5
Jul 03 12:51:13 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:14 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-782b4ada-322d-4c53-806f-a78ed05644b5" returned: 0 in 0.972s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Lock "cinder-quobyte-782b4ada-322d-4c53-806f-a78ed05644b5" released by "delete_volume" :: held 2.016s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:51:14 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Created reservations ['1d915166-f6c4-4998-8a02-5652d27ff0b8', 'a567b02d-ed37-418c-8840-857303841ba6', 'd687c786-4664-4aa9-b913-5836530f0d64', '55459e74-e29b-4705-ba89-48263b9cadcf'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:51:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:51:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:51:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:51:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:51:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:51:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:14 devstack sudo[91287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:51:14 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:15 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.967s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:51:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Deleted volume successfully.
Jul 03 12:51:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3d23bce5-79b4-47d7-9f12-9f7eb6d979d3 tempest-TaggedAttachmentsTest-2105322331 None] Lock "cinder-782b4ada-322d-4c53-806f-a78ed05644b5-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:51:24 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:51:25 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Flow 'volume_create_manager' (d9df5ea8-93c6-4140-a133-519c99d36030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fec9a6d-4f34-4f79-b6eb-9ae79ab6c727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fec9a6d-4f34-4f79-b6eb-9ae79ab6c727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-260146392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa506ed8-f4eb-4bef-a7dc-5056b8040fac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66f0800208c942329a19569b6be45a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:34Z,use_quota=True,user_id='93abb0b9ba484ced8f9fddd13989b154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4012b5c-f33a-406b-a6ac-395b1bf207cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4012b5c-f33a-406b-a6ac-395b1bf207cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9f2cdd-0b38-43e1-b97d-63b2692d17c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9f2cdd-0b38-43e1-b97d-63b2692d17c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa506ed8-f4eb-4bef-a7dc-5056b8040fac', 'volume_name': 'volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e792db-af2d-43a8-affd-dd1c3daf1542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e792db-af2d-43a8-affd-dd1c3daf1542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c765c2cb-fb7a-4f52-a892-bc667845b20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Volume aa506ed8-f4eb-4bef-a7dc-5056b8040fac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac', 'volume_size': 1}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-260146392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa506ed8-f4eb-4bef-a7dc-5056b8040fac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66f0800208c942329a19569b6be45a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:34Z,use_quota=True,user_id='93abb0b9ba484ced8f9fddd13989b154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Creating volume aa506ed8-f4eb-4bef-a7dc-5056b8040fac {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:51:34 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:51:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:34 devstack sudo[91493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac 1073741824
Jul 03 12:51:34 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:35 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac 1073741824" returned: 0 in 1.901s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:36 devstack sudo[91507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac
Jul 03 12:51:36 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:37 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac" returned: 0 in 1.525s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] <== create_volume: return (3582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:51:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.588s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:51:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c765c2cb-fb7a-4f52-a892-bc667845b20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282eb54e-4ae3-42f3-9f8c-a2224385701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:37 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Volume volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac (aa506ed8-f4eb-4bef-a7dc-5056b8040fac): created successfully
Jul 03 12:51:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282eb54e-4ae3-42f3-9f8c-a2224385701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Flow 'volume_create_manager' (d9df5ea8-93c6-4140-a133-519c99d36030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:51:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-56fb530b-9a0b-4440-a4e3-b3dad1ed816b tempest-VolumesTestJSON-842059086 None] Created volume successfully.
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Flow 'volume_create_manager' (c0eea507-7ac7-42bf-a5f4-ea59282d9b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f579837c-fd27-4a11-9cc5-9a98e2e7633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f579837c-fd27-4a11-9cc5-9a98e2e7633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-287728880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce02de9-85b6-4c58-8baf-e147315b8d2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66f0800208c942329a19569b6be45a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:40Z,use_quota=True,user_id='93abb0b9ba484ced8f9fddd13989b154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c488b7f9-b30c-476c-b223-7aa24bada324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c488b7f9-b30c-476c-b223-7aa24bada324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acdf0e1-85b4-46a9-ae09-18c44f91e18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acdf0e1-85b4-46a9-ae09-18c44f91e18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce02de9-85b6-4c58-8baf-e147315b8d2f', 'volume_name': 'volume-bce02de9-85b6-4c58-8baf-e147315b8d2f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d237bcf5-151e-4d3b-864c-ef9e28a3eb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d237bcf5-151e-4d3b-864c-ef9e28a3eb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab114c5f-c717-4f91-a0cb-92a53433b62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:39 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Volume bce02de9-85b6-4c58-8baf-e147315b8d2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce02de9-85b6-4c58-8baf-e147315b8d2f', 'volume_size': 1}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-287728880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce02de9-85b6-4c58-8baf-e147315b8d2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66f0800208c942329a19569b6be45a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:40Z,use_quota=True,user_id='93abb0b9ba484ced8f9fddd13989b154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Creating volume bce02de9-85b6-4c58-8baf-e147315b8d2f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:51:39 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:51:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:39 devstack sudo[91523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f 1073741824
Jul 03 12:51:39 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:41 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f 1073741824" returned: 0 in 1.280s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:41 devstack sudo[91529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f
Jul 03 12:51:41 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:42 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f" returned: 0 in 1.015s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] <== create_volume: return (2369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:51:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.373s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:51:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab114c5f-c717-4f91-a0cb-92a53433b62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce02de9-85b6-4c58-8baf-e147315b8d2f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f348335-3430-4998-9113-3206d8511c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:42 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Volume volume-bce02de9-85b6-4c58-8baf-e147315b8d2f (bce02de9-85b6-4c58-8baf-e147315b8d2f): created successfully
Jul 03 12:51:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f348335-3430-4998-9113-3206d8511c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Flow 'volume_create_manager' (c0eea507-7ac7-42bf-a5f4-ea59282d9b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:51:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-29c3f11a-61ea-467a-9ef8-458e3fc6ffb0 tempest-VolumesTestJSON-842059086 None] Created volume successfully.
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Flow 'volume_create_manager' (56963706-8615-4f69-b981-4b62ec9a5390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e104fc30-3e3d-442f-bf89-34ac78a50efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e104fc30-3e3d-442f-bf89-34ac78a50efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1106817428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66f0800208c942329a19569b6be45a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:44Z,use_quota=True,user_id='93abb0b9ba484ced8f9fddd13989b154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3047b2-b8ca-4ca0-adc1-ea4ec4f21517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3047b2-b8ca-4ca0-adc1-ea4ec4f21517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7535c8-14ac-43e7-b5e1-22f908176654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7535c8-14ac-43e7-b5e1-22f908176654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985', 'volume_name': 'volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821bb521-aff8-439d-ae9f-369d2785222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821bb521-aff8-439d-ae9f-369d2785222d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b2658a-0332-41de-91df-cb26ead2b02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Volume ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985', 'volume_size': 1}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1106817428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66f0800208c942329a19569b6be45a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:51:44Z,use_quota=True,user_id='93abb0b9ba484ced8f9fddd13989b154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Creating volume ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:51:44 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:51:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:44 devstack sudo[91534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985 1073741824
Jul 03 12:51:44 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:45 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985 1073741824" returned: 0 in 1.148s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:45 devstack sudo[91575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985
Jul 03 12:51:45 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:46 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985" returned: 0 in 1.099s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:51:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:51:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b2658a-0332-41de-91df-cb26ead2b02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbb6b2c-499c-4d63-b515-cb4d0b112d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:51:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Volume volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985 (ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985): created successfully
Jul 03 12:51:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbb6b2c-499c-4d63-b515-cb4d0b112d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:51:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Flow 'volume_create_manager' (56963706-8615-4f69-b981-4b62ec9a5390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:51:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f128fe21-b66e-48dc-b1a2-cf7eb66fd0f1 tempest-VolumesTestJSON-842059086 None] Created volume successfully.
Jul 03 12:51:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Acquiring lock "cinder-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:51:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Lock "cinder-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:51:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Acquiring lock "cinder-quobyte-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:51:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Lock "cinder-quobyte-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985" acquired by "delete_volume" :: waited 0.038s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:51:48 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9f56c5-9f0b-4b4b-b9ad-7284ca0d6bcd]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:51:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:49 devstack sudo[91578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985
Jul 03 12:51:49 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:50 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985" returned: 0 in 1.283s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:50 devstack sudo[91601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985
Jul 03 12:51:50 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:51 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985" returned: 0 in 0.870s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Lock "cinder-quobyte-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985" released by "delete_volume" :: held 2.233s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:51:51 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Created reservations ['4685db7e-b10f-409f-9af4-b60c11321dd7', '58a78bd1-a30d-44e6-9ce1-2bd50323b9dd', 'd9b8863d-b671-407d-b180-8aa00681316b', 'ecb76786-81d0-4a0a-a3b9-3cffbae32de3'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:51:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:51:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:51:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:51:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:51:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:51:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:51 devstack sudo[91614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:51:51 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:52 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.923s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:52 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:51:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Deleted volume successfully.
Jul 03 12:51:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Acquiring lock "cinder-bce02de9-85b6-4c58-8baf-e147315b8d2f-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:51:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Lock "cinder-bce02de9-85b6-4c58-8baf-e147315b8d2f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:51:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1ca9f93d-a53d-490e-bee7-1a7fb4eb6e1c tempest-VolumesTestJSON-842059086 None] Lock "cinder-ed32824a-d5e1-4e9e-9c5a-8a8c82ed6985-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:51:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Acquiring lock "cinder-quobyte-bce02de9-85b6-4c58-8baf-e147315b8d2f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:51:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Lock "cinder-quobyte-bce02de9-85b6-4c58-8baf-e147315b8d2f" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:51:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20cc255-45f2-4ba5-80ef-d8a7d6a1aac1]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:51:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:52 devstack sudo[91619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f
Jul 03 12:51:52 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:53 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f" returned: 0 in 1.284s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:53 devstack sudo[91663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f
Jul 03 12:51:53 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:54 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bce02de9-85b6-4c58-8baf-e147315b8d2f" returned: 0 in 0.976s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Lock "cinder-quobyte-bce02de9-85b6-4c58-8baf-e147315b8d2f" released by "delete_volume" :: held 2.337s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Created reservations ['86f889b9-c1c3-4589-967b-376b48faa0f2', '12dfc409-d97b-42d7-8e28-8097be4322d3', 'c7b1fdd5-050a-4f98-97ff-549d03fa1233', 'e415b38c-0710-47b2-a03a-cb4ead3a75b7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:51:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:51:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:54 devstack sudo[91669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:51:54 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Acquiring lock "cinder-aa506ed8-f4eb-4bef-a7dc-5056b8040fac-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Lock "cinder-aa506ed8-f4eb-4bef-a7dc-5056b8040fac-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Acquiring lock "cinder-quobyte-aa506ed8-f4eb-4bef-a7dc-5056b8040fac" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Lock "cinder-quobyte-aa506ed8-f4eb-4bef-a7dc-5056b8040fac" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:51:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcc6918-4d14-406d-bdaa-ddbcee0a89ec]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:51:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:55 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.895s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:51:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Deleted volume successfully.
Jul 03 12:51:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-204d6347-20dd-4ff4-9fae-4cff784bcf74 tempest-VolumesTestJSON-842059086 None] Lock "cinder-bce02de9-85b6-4c58-8baf-e147315b8d2f-delete_volume" released by "delete_volume" :: held 3.622s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:51:55 devstack sudo[91673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac
Jul 03 12:51:55 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:56 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac" returned: 0 in 0.974s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:56 devstack sudo[91678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac
Jul 03 12:51:56 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:57 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-aa506ed8-f4eb-4bef-a7dc-5056b8040fac" returned: 0 in 0.810s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Lock "cinder-quobyte-aa506ed8-f4eb-4bef-a7dc-5056b8040fac" released by "delete_volume" :: held 1.836s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Created reservations ['69322e67-37ca-4977-a0a0-bf2c4fd8bccb', '62ddd88c-aa4e-4a03-a33a-103bb222ad5f', 'ce65db42-2d9e-4d27-a052-fbcd596746a9', '02ee85ae-7b50-45da-acfd-f16b67356dd1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:51:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:51:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:51:57 devstack sudo[91682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:51:57 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:51:58 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root
Jul 03 12:51:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.257s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:51:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Deleted volume successfully.
Jul 03 12:51:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3e98989d-2e39-4ab8-b476-a552a7858d54 tempest-VolumesTestJSON-842059086 None] Lock "cinder-aa506ed8-f4eb-4bef-a7dc-5056b8040fac-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Acquiring lock "cinder-4bf984b8-5842-4198-90a8-decd1728e5b5-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Lock "cinder-4bf984b8-5842-4198-90a8-decd1728e5b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Acquiring lock "cinder-quobyte-4bf984b8-5842-4198-90a8-decd1728e5b5" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Lock "cinder-quobyte-4bf984b8-5842-4198-90a8-decd1728e5b5" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f042a582-d60a-4746-8fb7-e02131723cc3]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:01 devstack sudo[91693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5
Jul 03 12:52:01 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:02 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5" returned: 0 in 0.983s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:02 devstack sudo[91701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5
Jul 03 12:52:02 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:02 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4bf984b8-5842-4198-90a8-decd1728e5b5" returned: 0 in 0.743s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Lock "cinder-quobyte-4bf984b8-5842-4198-90a8-decd1728e5b5" released by "delete_volume" :: held 1.779s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:03 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Created reservations ['649c4cdf-00c7-46d0-9b07-af37442aa872', '983be67f-7482-4579-a45c-a80b56c79619', 'c72736fe-487b-4f87-aae9-141d7877cd2b', '90552553-9e07-47f5-bb47-dec8e0b26973'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:03 devstack sudo[91710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:52:03 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7ad2fd86-629a-4408-bd73-23fdcf02e85f tempest-GroupSnapshotsTest-1552653711 None] Group tempest-GroupSnapshotsTest-Group-1429504011: creating
Jul 03 12:52:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7ad2fd86-629a-4408-bd73-23fdcf02e85f tempest-GroupSnapshotsTest-1552653711 None] Group tempest-GroupSnapshotsTest-Group-1429504011: created successfully
Jul 03 12:52:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7ad2fd86-629a-4408-bd73-23fdcf02e85f tempest-GroupSnapshotsTest-1552653711 None] Create group completed successfully.
Jul 03 12:52:04 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.896s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:52:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Deleted volume successfully.
Jul 03 12:52:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-de5df04a-8a44-48f1-8631-9dfd42d02580 tempest-AttachVolumeShelveTestJSON-913854302 None] Lock "cinder-4bf984b8-5842-4198-90a8-decd1728e5b5-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:05 devstack sudo[91713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:52:05 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Flow 'volume_create_manager' (7c35c57f-f3d9-48f9-b5ab-7923b3efb9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bc97ea-b94e-41a1-8776-90c66a73029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bc97ea-b94e-41a1-8776-90c66a73029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1004653092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4af95c37-94cc-4952-acba-7d44cb92e962,host='devstack@QuobyteHD#QuobyteHD',id=32f1648d-7c00-4491-9a19-5e0dcc2fad5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141facd45fe4c05afa32eb122fb0628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:05Z,use_quota=True,user_id='b1859bffef1a428eb206bf23b0126277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ea4f04-f33b-4656-9921-f16b5e7e3623),volume_type_id=35ea4f04-f33b-4656-9921-f16b5e7e3623)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff56316d-2624-4df8-9dcd-95f10690230f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff56316d-2624-4df8-9dcd-95f10690230f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f510f884-5738-44dd-bc75-ef909620e411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f510f884-5738-44dd-bc75-ef909620e411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f1648d-7c00-4491-9a19-5e0dcc2fad5f', 'volume_name': 'volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2764361b-eef6-4a47-9bd4-81ff0cab6d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2764361b-eef6-4a47-9bd4-81ff0cab6d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2b2d76-55cc-4e5b-8bfc-1ddfadf2093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Volume 32f1648d-7c00-4491-9a19-5e0dcc2fad5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f', 'volume_size': 1}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4af95c37-94cc-4952-acba-7d44cb92e962,created_at=2026-07-03T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1004653092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4af95c37-94cc-4952-acba-7d44cb92e962,host='devstack@QuobyteHD#QuobyteHD',id=32f1648d-7c00-4491-9a19-5e0dcc2fad5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141facd45fe4c05afa32eb122fb0628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:05Z,use_quota=True,user_id='b1859bffef1a428eb206bf23b0126277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35ea4f04-f33b-4656-9921-f16b5e7e3623),volume_type_id=35ea4f04-f33b-4656-9921-f16b5e7e3623)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Creating volume 32f1648d-7c00-4491-9a19-5e0dcc2fad5f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:52:05 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:52:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:05 devstack sudo[91716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f 1073741824
Jul 03 12:52:05 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:06 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.159s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:52:06 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f 1073741824" returned: 0 in 1.141s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:07 devstack sudo[91726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f
Jul 03 12:52:07 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:07 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" returned: 0 in 0.927s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:52:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2b2d76-55cc-4e5b-8bfc-1ddfadf2093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16950a80-03cf-4f1f-9334-24ff89574ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:08 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Volume volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f (32f1648d-7c00-4491-9a19-5e0dcc2fad5f): created successfully
Jul 03 12:52:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16950a80-03cf-4f1f-9334-24ff89574ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Flow 'volume_create_manager' (7c35c57f-f3d9-48f9-b5ab-7923b3efb9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-62986847-9aab-42f7-b944-4055eef68a13 tempest-GroupSnapshotsTest-1552653711 None] Created volume successfully.
Jul 03 12:52:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] GroupSnapshot f111eb45-bda2-4981-9207-14c7f21f9ba6: creating.
Jul 03 12:52:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] Group snapshot f111eb45-bda2-4981-9207-14c7f21f9ba6: creating. {{(pid=86763) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 12:52:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] Creating offline snapshot 1ee7e5a2-d81d-4665-b2f3-45cb675eed61 of volume 32f1648d-7c00-4491-9a19-5e0dcc2fad5f {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:52:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51cf85b-3005-4184-8d76-b54b781678b2]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:08 devstack sudo[91743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f
Jul 03 12:52:08 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:09 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" returned: 0 in 1.201s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:10 devstack sudo[91750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61 1G
Jul 03 12:52:10 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:11 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61 1G" returned: 0 in 1.092s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:11 devstack sudo[91756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61
Jul 03 12:52:11 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:11 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61" returned: 0 in 0.873s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:11 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:52:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:11 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61
Jul 03 12:52:11 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:12 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61" returned: 0 in 0.764s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:12 devstack sudo[91768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.info
Jul 03 12:52:12 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:13 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.info" returned: 0 in 0.902s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:13 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:52:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:13 devstack sudo[91773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.info
Jul 03 12:52:13 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Flow 'volume_create_manager' (9418dee0-4829-4794-b119-b7d5ad0b9745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a961b9-564e-43a9-a64e-adb58b69b19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a961b9-564e-43a9-a64e-adb58b69b19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1955984880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61343553-5535-48ad-8a5c-af8d9213d8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='638d01ea33be401e838cbb6a9b6999fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:14Z,use_quota=True,user_id='4eba556edd0245998674a29784c0f61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af000dc-7d0c-4533-b5df-19e38e6caef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af000dc-7d0c-4533-b5df-19e38e6caef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66c7ba7-d265-4a89-9047-929a3ce3ca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66c7ba7-d265-4a89-9047-929a3ce3ca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61343553-5535-48ad-8a5c-af8d9213d8e0', 'volume_name': 'volume-61343553-5535-48ad-8a5c-af8d9213d8e0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e73e1fe-756a-44ef-b4f5-f9299909c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e73e1fe-756a-44ef-b4f5-f9299909c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d88d471-831d-46c3-bff6-4d95ed2462f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:14 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Volume 61343553-5535-48ad-8a5c-af8d9213d8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61343553-5535-48ad-8a5c-af8d9213d8e0', 'volume_size': 1}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Flow 'volume_create_manager' (64ac1fcb-c757-4ba4-afcb-36322efc5d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12f23b4-c8da-4c35-a85c-fdb4d277216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12f23b4-c8da-4c35-a85c-fdb4d277216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-724187763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920b0464-ab6d-45c3-a326-0b71cdeec47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952fd3931f1443fe9f432920653accbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:15Z,use_quota=True,user_id='9aab5a8786504a628a008febc2f0aff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34c33b1-3f12-470a-af2c-c4934e79fbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34c33b1-3f12-470a-af2c-c4934e79fbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0271a01f-c8a4-479a-a8df-f0cb412fdf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0271a01f-c8a4-479a-a8df-f0cb412fdf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920b0464-ab6d-45c3-a326-0b71cdeec47c', 'volume_name': 'volume-920b0464-ab6d-45c3-a326-0b71cdeec47c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9273a49-e4b8-497a-98e2-0c64a96daf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9273a49-e4b8-497a-98e2-0c64a96daf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ed4e17-2a56-4ff8-ba54-8fdc14b74815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:14 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Volume 920b0464-ab6d-45c3-a326-0b71cdeec47c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920b0464-ab6d-45c3-a326-0b71cdeec47c', 'volume_size': 1}
Jul 03 12:52:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:15 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.info" returned: 0 in 1.405s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.366s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1955984880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61343553-5535-48ad-8a5c-af8d9213d8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='638d01ea33be401e838cbb6a9b6999fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:14Z,use_quota=True,user_id='4eba556edd0245998674a29784c0f61d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Creating volume 61343553-5535-48ad-8a5c-af8d9213d8e0 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:52:15 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:52:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:15 devstack sudo[91834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0 1073741824
Jul 03 12:52:15 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8cdfe360-95f5-42c6-a5a1-aa5b0e164168 tempest-GroupSnapshotsTest-1552653711 None] group_snapshot f111eb45-bda2-4981-9207-14c7f21f9ba6: created successfully
Jul 03 12:52:16 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0 1073741824" returned: 0 in 1.558s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:16 devstack sudo[91849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0
Jul 03 12:52:16 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:17 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0" returned: 0 in 1.031s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] <== create_volume: return (2663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.668s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-724187763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920b0464-ab6d-45c3-a326-0b71cdeec47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952fd3931f1443fe9f432920653accbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:15Z,use_quota=True,user_id='9aab5a8786504a628a008febc2f0aff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Creating volume 920b0464-ab6d-45c3-a326-0b71cdeec47c {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:52:17 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d88d471-831d-46c3-bff6-4d95ed2462f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61343553-5535-48ad-8a5c-af8d9213d8e0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1012a32b-3d47-40cb-a997-951807ee936e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:17 devstack sudo[91852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c 1073741824
Jul 03 12:52:17 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:17 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Volume volume-61343553-5535-48ad-8a5c-af8d9213d8e0 (61343553-5535-48ad-8a5c-af8d9213d8e0): created successfully
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1012a32b-3d47-40cb-a997-951807ee936e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Flow 'volume_create_manager' (9418dee0-4829-4794-b119-b7d5ad0b9745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-65f3a3d5-4353-4f7c-a9cb-bb7fc77d9129 req-bd951fc8-e456-4bbc-8575-7274653abdbb tempest-VolumesSnapshotsTestJSON-503266178 None] Created volume successfully.
Jul 03 12:52:19 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c 1073741824" returned: 0 in 1.356s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:19 devstack sudo[91858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c
Jul 03 12:52:19 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:20 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c" returned: 0 in 0.983s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] <== create_volume: return (2448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.455s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.485s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-1ee7e5a2-d81d-4665-b2f3-45cb675eed61-d0b26f73-1d21-420b-8efb-f637b797948f" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ed4e17-2a56-4ff8-ba54-8fdc14b74815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920b0464-ab6d-45c3-a326-0b71cdeec47c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fe1402-9f4e-4275-b829-a075b5fb0009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-1ee7e5a2-d81d-4665-b2f3-45cb675eed61-d0b26f73-1d21-420b-8efb-f637b797948f" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Creating volume d0b26f73-1d21-420b-8efb-f637b797948f from snapshot 1ee7e5a2-d81d-4665-b2f3-45cb675eed61 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-d0b26f73-1d21-420b-8efb-f637b797948f" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:20 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Volume volume-920b0464-ab6d-45c3-a326-0b71cdeec47c (920b0464-ab6d-45c3-a326-0b71cdeec47c): created successfully
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fe1402-9f4e-4275-b829-a075b5fb0009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Flow 'volume_create_manager' (64ac1fcb-c757-4ba4-afcb-36322efc5d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-779aa8f0-a0a6-49d4-a0ea-79d6bd44f170 tempest-AttachVolumeTestJSON-58977977 None] Created volume successfully.
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-d0b26f73-1d21-420b-8efb-f637b797948f" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] snapshot: 1ee7e5a2-d81d-4665-b2f3-45cb675eed61, volume: d0b26f73-1d21-420b-8efb-f637b797948f,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[af88e972-325f-4301-ba1b-714d789952ba]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:20 devstack sudo[91863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61
Jul 03 12:52:20 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:21 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61" returned: 0 in 1.019s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 12:52:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 12:52:21 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f7e2bb-833b-4e2d-8b13-0c6618be3262]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:21 devstack sudo[91873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f
Jul 03 12:52:21 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:22 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" returned: 0 in 0.849s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:22 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 12:52:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:22 devstack sudo[91878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f
Jul 03 12:52:22 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:25 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=44,cinder:UPDATE=57,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:52:25 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=43,cinder:UPDATE=50,cinder:DELETE=7,cinder:INSERT=12 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:52:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-16fd0769-348a-4342-a62a-54fbd7825301 req-319e114b-f5c6-46af-9610-404ac9d07ed7 tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:29 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f" returned: 0 in 7.409s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[94404115-a7ac-4050-b69b-429ec234891c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:29 devstack sudo[91939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f
Jul 03 12:52:29 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:30 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" returned: 0 in 1.073s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:30 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 12:52:30 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Converted 1024.00 MB image at 138.19 MB/s
Jul 03 12:52:30 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:52:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:30 devstack sudo[91944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f
Jul 03 12:52:30 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:31 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f" returned: 0 in 0.707s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-d0b26f73-1d21-420b-8efb-f637b797948f" released by "_copy_volume_from_snapshot" :: held 11.172s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-1ee7e5a2-d81d-4665-b2f3-45cb675eed61-d0b26f73-1d21-420b-8efb-f637b797948f" released by "_create_volume_from_snapshot" :: held 11.258s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.299s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.320s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] Creating offline snapshot 0443033f-3863-48bb-a762-8ea20ce587a1 of volume 61343553-5535-48ad-8a5c-af8d9213d8e0 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:52:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab9ae05-1c1d-471f-b7ea-78334f292aa0]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8b52f931-3b33-48e6-8f18-ae7442954429 tempest-GroupSnapshotsTest-1552653711 None] Create group from source-snapshot-f111eb45-bda2-4981-9207-14c7f21f9ba6 completed successfully.
Jul 03 12:52:31 devstack sudo[91947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0
Jul 03 12:52:31 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:32 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0" returned: 0 in 0.839s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:32 devstack sudo[91952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1 1G
Jul 03 12:52:32 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:33 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1 1G" returned: 0 in 0.869s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61343553-5535-48ad-8a5c-af8d9213d8e0 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:33 devstack sudo[91957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61343553-5535-48ad-8a5c-af8d9213d8e0 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1
Jul 03 12:52:33 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-d0b26f73-1d21-420b-8efb-f637b797948f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-d0b26f73-1d21-420b-8efb-f637b797948f" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a34a465-bd83-4a67-856c-4680d0d04572]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:33 devstack sudo[91959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f
Jul 03 12:52:33 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:34 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61343553-5535-48ad-8a5c-af8d9213d8e0 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1" returned: 0 in 0.852s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:34 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1 is being set with open permissions: ugo+rw
Jul 03 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:34 devstack sudo[91964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1
Jul 03 12:52:34 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:34 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f" returned: 0 in 0.845s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:34 devstack sudo[91969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f
Jul 03 12:52:34 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:34 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1" returned: 0 in 0.792s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:35 devstack sudo[91973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.info
Jul 03 12:52:35 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:35 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d0b26f73-1d21-420b-8efb-f637b797948f" returned: 0 in 0.883s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-d0b26f73-1d21-420b-8efb-f637b797948f" released by "delete_volume" :: held 1.795s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['646475d0-1ae1-4780-8b6b-e5b3cdc916cf'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:52:35 devstack cinder-volume[86763]: WARNING cinder.quota [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1310710329 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1310710329, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:52:35 devstack cinder-volume[86763]: WARNING cinder.quota [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1310710329 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1310710329, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['4643ba90-b537-41b4-9d6b-6ebf561eea72', '4fb70914-db16-4b20-be62-c90e54929f94', 'f86b2f44-802f-4afb-b2a0-dd03baec25be', '95d487e3-ffe8-4182-b815-dafd7e4bb7aa'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:52:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:35 devstack sudo[91976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:52:35 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:36 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.info" returned: 0 in 0.988s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:36 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.info is being set with open permissions: ugo+rw
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:36 devstack sudo[91983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.info
Jul 03 12:52:36 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] group_snapshot f111eb45-bda2-4981-9207-14c7f21f9ba6: deleting
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] group_snapshot f111eb45-bda2-4981-9207-14c7f21f9ba6: deleting {{(pid=86763) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-1ee7e5a2-d81d-4665-b2f3-45cb675eed61" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-1ee7e5a2-d81d-4665-b2f3-45cb675eed61" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Deleting offline snapshot 1ee7e5a2-d81d-4665-b2f3-45cb675eed61 of volume 32f1648d-7c00-4491-9a19-5e0dcc2fad5f {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] snapshot_file for this snap is: volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[336e2e9a-09e4-4fe2-9458-3f9eece4635e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:36 devstack sudo[91992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61
Jul 03 12:52:36 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:36 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.229s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:36 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:52:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-79077552-f4a8-41e3-a386-0a1dcbe4081b tempest-GroupSnapshotsTest-1552653711 None] Delete group completed successfully.
Jul 03 12:52:37 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.info" returned: 0 in 1.085s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.569s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-16fd0769-348a-4342-a62a-54fbd7825301 req-319e114b-f5c6-46af-9610-404ac9d07ed7 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.111s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8346c24-ce4c-4032-8ed3-2749a4a921a3]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-16fd0769-348a-4342-a62a-54fbd7825301 req-319e114b-f5c6-46af-9610-404ac9d07ed7 tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-8fca44aa-e2a7-40bb-8332-9c86b296cfcc req-5761ec70-8121-4b36-855e-82fb6e366b2f tempest-VolumesSnapshotsTestJSON-503266178 None] Create snapshot completed successfully
Jul 03 12:52:37 devstack sudo[91999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c
Jul 03 12:52:37 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:37 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61" returned: 0 in 1.145s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea14ce67-a426-456a-9e39-62bf7c46a18f]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:37 devstack sudo[92004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f
Jul 03 12:52:37 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Acquiring lock "cinder-0443033f-3863-48bb-a762-8ea20ce587a1-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "cinder-0443033f-3863-48bb-a762-8ea20ce587a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Acquiring lock "cinder-quobyte-61343553-5535-48ad-8a5c-af8d9213d8e0" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "cinder-quobyte-61343553-5535-48ad-8a5c-af8d9213d8e0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Acquiring lock "cinder-quobyte-0443033f-3863-48bb-a762-8ea20ce587a1" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "cinder-quobyte-0443033f-3863-48bb-a762-8ea20ce587a1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Deleting offline snapshot 0443033f-3863-48bb-a762-8ea20ce587a1 of volume 61343553-5535-48ad-8a5c-af8d9213d8e0 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:52:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] snapshot_file for this snap is: volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:52:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5bc4c7-077e-4024-ad9e-e449431f98f8]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:38 devstack sudo[92008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1
Jul 03 12:52:38 devstack sudo[92008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:38 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-16fd0769-348a-4342-a62a-54fbd7825301 req-319e114b-f5c6-46af-9610-404ac9d07ed7 tempest-AttachVolumeTestJSON-58977977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c" returned: 0 in 1.002s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-16fd0769-348a-4342-a62a-54fbd7825301 req-319e114b-f5c6-46af-9610-404ac9d07ed7 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.032s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-16fd0769-348a-4342-a62a-54fbd7825301 req-319e114b-f5c6-46af-9610-404ac9d07ed7 tempest-AttachVolumeTestJSON-58977977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-920b0464-ab6d-45c3-a326-0b71cdeec47c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5e86b24-976f-41a8-8058-4f13527f76a6', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:52:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-16fd0769-348a-4342-a62a-54fbd7825301 req-319e114b-f5c6-46af-9610-404ac9d07ed7 tempest-AttachVolumeTestJSON-58977977 None] attachment_update completed successfully.
Jul 03 12:52:38 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" returned: 0 in 1.041s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:38 devstack sudo[92081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61
Jul 03 12:52:38 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:38 devstack sudo[92008]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1" returned: 0 in 0.930s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61343553-5535-48ad-8a5c-af8d9213d8e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:52:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d9fff1-fe8e-43eb-b73f-9a1e7b36e398]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:39 devstack sudo[92086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0
Jul 03 12:52:39 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:39 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61" returned: 0 in 0.919s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:39 devstack sudo[92407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61
Jul 03 12:52:39 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:39 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0" returned: 0 in 0.915s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:39 devstack sudo[92412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1
Jul 03 12:52:39 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:40 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f.1ee7e5a2-d81d-4665-b2f3-45cb675eed61" returned: 0 in 0.852s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-1ee7e5a2-d81d-4665-b2f3-45cb675eed61" released by "_delete_snapshot" :: held 4.139s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" released by "delete_snapshot" :: held 4.200s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:40 devstack cinder-volume[86763]: WARNING cinder.quota [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1310710329 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1310710329, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:52:40 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['b57e831b-67eb-4658-9212-425eba8983cc', '9f154460-f87b-4eb8-a040-377d88b36466', 'fb2dcff1-270f-4f99-a269-6453fd0e4f6c', '05f81997-6e1c-4b95-b375-89540929e7bf'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:52:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9871d9f3-4b76-43b1-9215-e14d6ba6d2ce tempest-GroupSnapshotsTest-1552653711 None] group_snapshot f111eb45-bda2-4981-9207-14c7f21f9ba6: deleted successfully
Jul 03 12:52:40 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1" returned: 0 in 0.980s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:40 devstack sudo[92420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1
Jul 03 12:52:40 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f57512-0ced-4d40-b32a-3c9e859454f9]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Flow 'volume_create_manager' (fd3bde47-5b43-4e1d-8237-7a1cac7b46f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:41 devstack sudo[92422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f
Jul 03 12:52:41 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f656f5-6177-44fd-b646-0a7ba3da9961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f656f5-6177-44fd-b646-0a7ba3da9961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1037662356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a55196c-572a-412f-b18c-df373d3a4b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fefdcc1dc21640b5b9a43ab32cf9712f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:42Z,use_quota=True,user_id='a18a854ff2eb46fbb09efaaa3870640e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36a9a08-4e6b-4745-8396-23a9605a68ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36a9a08-4e6b-4745-8396-23a9605a68ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cacd48-3627-4a86-ad4d-de437ed8d553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cacd48-3627-4a86-ad4d-de437ed8d553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a55196c-572a-412f-b18c-df373d3a4b3b', 'volume_name': 'volume-6a55196c-572a-412f-b18c-df373d3a4b3b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43045b51-0b26-4146-96cd-818216656290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43045b51-0b26-4146-96cd-818216656290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb3cc69-d2d7-4b98-bd4d-47c3abfa418b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:41 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Volume 6a55196c-572a-412f-b18c-df373d3a4b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a55196c-572a-412f-b18c-df373d3a4b3b', 'volume_size': 1}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1037662356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a55196c-572a-412f-b18c-df373d3a4b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fefdcc1dc21640b5b9a43ab32cf9712f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:42Z,use_quota=True,user_id='a18a854ff2eb46fbb09efaaa3870640e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Creating volume 6a55196c-572a-412f-b18c-df373d3a4b3b {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:52:41 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:52:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:41 devstack sudo[92424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b 1073741824
Jul 03 12:52:41 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:42 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0.0443033f-3863-48bb-a762-8ea20ce587a1" returned: 0 in 1.319s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "cinder-quobyte-0443033f-3863-48bb-a762-8ea20ce587a1" released by "_delete_snapshot" :: held 4.338s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "cinder-quobyte-61343553-5535-48ad-8a5c-af8d9213d8e0" released by "delete_snapshot" :: held 4.387s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:42 devstack cinder-volume[86763]: WARNING cinder.quota [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.quota [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Created reservations ['f2933a90-650f-41a0-9407-fbcb4a9c1d8d', 'a2d592d9-584f-43c6-8bcf-e33191055244', '700b8ac7-8646-4cb7-80b3-892129ea68d3', '48b2fa9e-ca18-42b1-b21b-684b801e0ddb'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:52:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Delete snapshot completed successfully.
Jul 03 12:52:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-90ba3266-ce53-47a8-9531-902e15fbef65 req-dd3f3f34-1aab-4f9e-9641-c44b3bb4eaf2 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "cinder-0443033f-3863-48bb-a762-8ea20ce587a1-delete_snapshot" released by "delete_snapshot" :: held 4.721s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:42 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" returned: 0 in 1.331s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:42 devstack sudo[92435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f
Jul 03 12:52:42 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b 1073741824" returned: 0 in 1.276s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:42 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:43 devstack sudo[92437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b
Jul 03 12:52:43 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:43 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" returned: 0 in 0.864s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Acquiring lock "cinder-61343553-5535-48ad-8a5c-af8d9213d8e0-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-32f1648d-7c00-4491-9a19-5e0dcc2fad5f" released by "delete_volume" :: held 2.334s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "cinder-61343553-5535-48ad-8a5c-af8d9213d8e0-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Acquiring lock "cinder-quobyte-61343553-5535-48ad-8a5c-af8d9213d8e0" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:52:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "cinder-quobyte-61343553-5535-48ad-8a5c-af8d9213d8e0" acquired by "delete_volume" :: waited 0.043s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:52:44 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b" returned: 0 in 1.029s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] <== create_volume: return (2367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.370s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['0f72760a-47ee-49a9-9db0-3e1620625d18'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[44304c1c-fc5a-47ae-96c4-dbfda0e6c0cd]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb3cc69-d2d7-4b98-bd4d-47c3abfa418b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a55196c-572a-412f-b18c-df373d3a4b3b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd74ee39-4cea-4e77-b4cd-4df7f09dfe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Volume volume-6a55196c-572a-412f-b18c-df373d3a4b3b (6a55196c-572a-412f-b18c-df373d3a4b3b): created successfully
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd74ee39-4cea-4e77-b4cd-4df7f09dfe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Flow 'volume_create_manager' (fd3bde47-5b43-4e1d-8237-7a1cac7b46f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e1474418-c940-4d24-99f5-620b96ffa78f tempest-ServerActionsTestOtherA-1688824323 None] Created volume successfully.
Jul 03 12:52:44 devstack cinder-volume[86763]: WARNING cinder.db.sqlalchemy.api [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1310710329']
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['7cd4cb89-7f32-4b5c-a894-733d6b0773c2', 'bcf98981-c6e6-48da-80cb-532e05976de7', '886e3705-b861-4a22-b309-df3638e7923a', 'f87fb495-bee6-4d8e-afd6-32e668629baa'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:52:44 devstack sudo[92441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0
Jul 03 12:52:44 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Flow 'volume_create_manager' (47398c35-5196-4b2b-9be5-c6d1a565676b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2dcdb5-e3cd-4572-a7c4-1fbaa0c3dfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2dcdb5-e3cd-4572-a7c4-1fbaa0c3dfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-633153385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8488d83-8e34-4345-95f1-7a32aab5a5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952fd3931f1443fe9f432920653accbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:44Z,use_quota=True,user_id='9aab5a8786504a628a008febc2f0aff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95aa1d5b-6c2a-43d9-bed4-6948cf78c39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95aa1d5b-6c2a-43d9-bed4-6948cf78c39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f7791f-2e07-444d-a402-0221d2736fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f7791f-2e07-444d-a402-0221d2736fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8488d83-8e34-4345-95f1-7a32aab5a5ee', 'volume_name': 'volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b7924f-dc84-40a3-a936-25dc6b281226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b7924f-dc84-40a3-a936-25dc6b281226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afd2d0c-9871-4aff-9291-466ca9792a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Volume e8488d83-8e34-4345-95f1-7a32aab5a5ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee', 'volume_size': 1}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-633153385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8488d83-8e34-4345-95f1-7a32aab5a5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952fd3931f1443fe9f432920653accbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:44Z,use_quota=True,user_id='9aab5a8786504a628a008febc2f0aff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Creating volume e8488d83-8e34-4345-95f1-7a32aab5a5ee {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:52:44 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:44 devstack sudo[92443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee 1073741824
Jul 03 12:52:44 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:44 devstack sudo[92445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:52:44 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:45 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0" returned: 0 in 1.212s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:45 devstack sudo[92453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0
Jul 03 12:52:45 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:45 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.112s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:45 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:52:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5286f0bb-21ed-4fdc-812c-ba8fbae2f006 tempest-GroupSnapshotsTest-1552653711 None] Delete group completed successfully.
Jul 03 12:52:45 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee 1073741824" returned: 0 in 1.423s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:46 devstack sudo[92491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee
Jul 03 12:52:46 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b9c79be7-a442-4a3e-a365-0c58ecdf94ee tempest-GroupSnapshotsTest-1552653711 None] Group tempest-GroupSnapshotsTest-Group-1876019803: creating
Jul 03 12:52:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b9c79be7-a442-4a3e-a365-0c58ecdf94ee tempest-GroupSnapshotsTest-1552653711 None] Group tempest-GroupSnapshotsTest-Group-1876019803: created successfully
Jul 03 12:52:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b9c79be7-a442-4a3e-a365-0c58ecdf94ee tempest-GroupSnapshotsTest-1552653711 None] Create group completed successfully.
Jul 03 12:52:46 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-61343553-5535-48ad-8a5c-af8d9213d8e0" returned: 0 in 1.197s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "cinder-quobyte-61343553-5535-48ad-8a5c-af8d9213d8e0" released by "delete_volume" :: held 2.557s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.quota [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Created reservations ['a8bf4d6e-2f2f-4d99-a0ee-7484387eaad9', '36a5bbf5-3dbb-4a98-88be-f9c7b6f2704a', 'dd78cfbe-a950-4220-8542-e872048c2e75', '28fa8b52-e994-4f78-8a4d-dac8149d9e7e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:46 devstack sudo[92499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:52:46 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:46 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee" returned: 0 in 0.930s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] <== create_volume: return (2438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.441s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afd2d0c-9871-4aff-9291-466ca9792a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb237cc8-efef-48d7-8f9f-99a7f885c898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Volume volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee (e8488d83-8e34-4345-95f1-7a32aab5a5ee): created successfully
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb237cc8-efef-48d7-8f9f-99a7f885c898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Flow 'volume_create_manager' (47398c35-5196-4b2b-9be5-c6d1a565676b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ca8d9ea2-8c65-48bb-ac47-0a0b157485e7 tempest-AttachVolumeTestJSON-58977977 None] Created volume successfully.
Jul 03 12:52:47 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.867s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.manager [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:52:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Deleted volume successfully.
Jul 03 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-dff96685-bc9c-4aa9-bb83-810a7703e554 req-1df82ada-fecc-4a9d-b790-7557d4dddb48 tempest-VolumesSnapshotsTestJSON-503266178 None] Lock "cinder-61343553-5535-48ad-8a5c-af8d9213d8e0-delete_volume" released by "delete_volume" :: held 3.817s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:52:47 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Flow 'volume_create_manager' (b422f23a-9858-4efe-a1c6-42d94a8221b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3ccc4e-27d6-4838-b0d9-467c10415d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3ccc4e-27d6-4838-b0d9-467c10415d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-585429020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2aef0fcb-3f17-4e5c-a7d2-682a340b9b11,host='devstack@QuobyteHD#QuobyteHD',id=4db47457-e620-424d-a144-a1c7fadc45d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141facd45fe4c05afa32eb122fb0628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:48Z,use_quota=True,user_id='b1859bffef1a428eb206bf23b0126277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3add7cc-3619-4495-b463-fba7c0603289),volume_type_id=a3add7cc-3619-4495-b463-fba7c0603289)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac3a8d0-c116-4e92-ab1d-30a554cf4704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac3a8d0-c116-4e92-ab1d-30a554cf4704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c31279-afc5-48c0-a8ad-6b6b2f03e759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c31279-afc5-48c0-a8ad-6b6b2f03e759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db47457-e620-424d-a144-a1c7fadc45d0', 'volume_name': 'volume-4db47457-e620-424d-a144-a1c7fadc45d0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85cac71-b010-46b3-bd8e-d86cdaf2d870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85cac71-b010-46b3-bd8e-d86cdaf2d870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21eda722-d4cc-4002-9432-919755ca2ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:48 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Volume 4db47457-e620-424d-a144-a1c7fadc45d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db47457-e620-424d-a144-a1c7fadc45d0', 'volume_size': 1}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2aef0fcb-3f17-4e5c-a7d2-682a340b9b11,created_at=2026-07-03T10:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-585429020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2aef0fcb-3f17-4e5c-a7d2-682a340b9b11,host='devstack@QuobyteHD#QuobyteHD',id=4db47457-e620-424d-a144-a1c7fadc45d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141facd45fe4c05afa32eb122fb0628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:48Z,use_quota=True,user_id='b1859bffef1a428eb206bf23b0126277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3add7cc-3619-4495-b463-fba7c0603289),volume_type_id=a3add7cc-3619-4495-b463-fba7c0603289)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Creating volume 4db47457-e620-424d-a144-a1c7fadc45d0 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:52:48 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:52:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:48 devstack sudo[92509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0 1073741824
Jul 03 12:52:48 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:49 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0 1073741824" returned: 0 in 1.160s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:49 devstack sudo[92515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0
Jul 03 12:52:49 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:50 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0" returned: 0 in 0.879s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:52:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21eda722-d4cc-4002-9432-919755ca2ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db47457-e620-424d-a144-a1c7fadc45d0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82245f47-149a-46b3-a46a-3c4be44fb432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:50 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Volume volume-4db47457-e620-424d-a144-a1c7fadc45d0 (4db47457-e620-424d-a144-a1c7fadc45d0): created successfully
Jul 03 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82245f47-149a-46b3-a46a-3c4be44fb432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Flow 'volume_create_manager' (b422f23a-9858-4efe-a1c6-42d94a8221b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f64aa909-117c-43e2-97b0-a9707411a36a tempest-GroupSnapshotsTest-1552653711 None] Created volume successfully.
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Flow 'volume_create_manager' (5bd27e9b-5046-4f0f-87fa-cee4f1f9a881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e999534a-1a5f-44b5-81d4-950d34c61dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e999534a-1a5f-44b5-81d4-950d34c61dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1018503459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2aef0fcb-3f17-4e5c-a7d2-682a340b9b11,host='devstack@QuobyteHD#QuobyteHD',id=49e26470-c797-47b3-a016-dc22a66c8407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141facd45fe4c05afa32eb122fb0628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:51Z,use_quota=True,user_id='b1859bffef1a428eb206bf23b0126277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3add7cc-3619-4495-b463-fba7c0603289),volume_type_id=a3add7cc-3619-4495-b463-fba7c0603289)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0c93e8-d8a5-4da4-bf79-134d1791ba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0c93e8-d8a5-4da4-bf79-134d1791ba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b564eae9-e2a0-48c2-a96f-e1da5747db72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b564eae9-e2a0-48c2-a96f-e1da5747db72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e26470-c797-47b3-a016-dc22a66c8407', 'volume_name': 'volume-49e26470-c797-47b3-a016-dc22a66c8407', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cab406-998b-4d69-816b-4384517b22aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cab406-998b-4d69-816b-4384517b22aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf739cc7-910d-4f5e-b5fe-47b3bf6821d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:51 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Volume 49e26470-c797-47b3-a016-dc22a66c8407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e26470-c797-47b3-a016-dc22a66c8407', 'volume_size': 1}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2aef0fcb-3f17-4e5c-a7d2-682a340b9b11,created_at=2026-07-03T10:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1018503459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2aef0fcb-3f17-4e5c-a7d2-682a340b9b11,host='devstack@QuobyteHD#QuobyteHD',id=49e26470-c797-47b3-a016-dc22a66c8407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141facd45fe4c05afa32eb122fb0628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:52:51Z,use_quota=True,user_id='b1859bffef1a428eb206bf23b0126277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3add7cc-3619-4495-b463-fba7c0603289),volume_type_id=a3add7cc-3619-4495-b463-fba7c0603289)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Creating volume 49e26470-c797-47b3-a016-dc22a66c8407 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:52:51 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-6d9fc089-f4fc-4cef-981a-05d906f24368 req-90a1f0a0-73cd-4e48-afd9-7b26e62fff0a tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:52:51 devstack sudo[92528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407 1073741824
Jul 03 12:52:51 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:52 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407 1073741824" returned: 0 in 1.077s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:52 devstack sudo[92534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407
Jul 03 12:52:52 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:53 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407" returned: 0 in 1.062s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-6d9fc089-f4fc-4cef-981a-05d906f24368 req-90a1f0a0-73cd-4e48-afd9-7b26e62fff0a tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.189s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf739cc7-910d-4f5e-b5fe-47b3bf6821d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e26470-c797-47b3-a016-dc22a66c8407', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6689a9a-3416-450a-ae06-64e3e01ad56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:52:53 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb2bace-2736-488f-875c-b2c607135b1c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:52:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6d9fc089-f4fc-4cef-981a-05d906f24368 req-90a1f0a0-73cd-4e48-afd9-7b26e62fff0a tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Volume volume-49e26470-c797-47b3-a016-dc22a66c8407 (49e26470-c797-47b3-a016-dc22a66c8407): created successfully
Jul 03 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6689a9a-3416-450a-ae06-64e3e01ad56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:52:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Flow 'volume_create_manager' (5bd27e9b-5046-4f0f-87fa-cee4f1f9a881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:52:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-473ebac3-25d6-43e3-94dd-c9d878256326 tempest-GroupSnapshotsTest-1552653711 None] Created volume successfully.
Jul 03 12:52:53 devstack sudo[92538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee
Jul 03 12:52:53 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:54 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6d9fc089-f4fc-4cef-981a-05d906f24368 req-90a1f0a0-73cd-4e48-afd9-7b26e62fff0a tempest-AttachVolumeTestJSON-58977977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee" returned: 0 in 1.356s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-6d9fc089-f4fc-4cef-981a-05d906f24368 req-90a1f0a0-73cd-4e48-afd9-7b26e62fff0a tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.430s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:52:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-6d9fc089-f4fc-4cef-981a-05d906f24368 req-90a1f0a0-73cd-4e48-afd9-7b26e62fff0a tempest-AttachVolumeTestJSON-58977977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56be6952-dbd0-4962-819a-b88e8a318ae2', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:52:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-6d9fc089-f4fc-4cef-981a-05d906f24368 req-90a1f0a0-73cd-4e48-afd9-7b26e62fff0a tempest-AttachVolumeTestJSON-58977977 None] attachment_update completed successfully.
Jul 03 12:52:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c2047c80-1d27-4a1d-8039-03c27c71442a tempest-GroupSnapshotsTest-1552653711 None] Update group completed successfully.
Jul 03 12:52:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-121d99fd-cd55-450a-9f59-08b3b26858fa tempest-GroupSnapshotsTest-1552653711 None] Update group completed successfully.
Jul 03 12:52:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-977ef3ac-e984-4026-a3bc-ee2e90262e20 tempest-GroupSnapshotsTest-1552653711 None] Update group completed successfully.
Jul 03 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-519dd92f-e7f2-4b7a-982f-8f3fbaa2df2d tempest-BackendsCapabilitiesAdminTestsJSON-1229087275 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7313270568848, 'free_capacity_gb': 1775.7313270568848, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86763) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 12:52:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4b0e1fab-5fa5-4a40-8dd9-979c0c2a10a0 tempest-BackendsCapabilitiesAdminTestsJSON-1229087275 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7313270568848, 'free_capacity_gb': 1775.7313270568848, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86763) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 12:52:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-210fbf04-d7cc-4a37-bb60-248c8b770623 tempest-GroupSnapshotsTest-1552653711 None] Update group completed successfully.
Jul 03 12:53:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] GroupSnapshot 2d1495b2-97b0-40ab-a78a-319930e2c518: creating.
Jul 03 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Group snapshot 2d1495b2-97b0-40ab-a78a-319930e2c518: creating. {{(pid=86763) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Creating offline snapshot 8f0ab3ab-5293-4477-8dc2-c8c926ff54fc of volume 49e26470-c797-47b3-a016-dc22a66c8407 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:53:00 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cade567-4f38-4334-babe-027d5d1b86b0]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:01 devstack sudo[92619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407
Jul 03 12:53:01 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-8f4d5901-c203-411c-83e5-91c64d3fa8ba req-88457497-98e0-4e92-9424-f327ebb7cd17 tempest-AttachVolumeTestJSON-58977977 None] Terminate volume connection completed successfully.
Jul 03 12:53:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-8f4d5901-c203-411c-83e5-91c64d3fa8ba req-88457497-98e0-4e92-9424-f327ebb7cd17 tempest-AttachVolumeTestJSON-58977977 None] Deleting attachment e5e86b24-976f-41a8-8058-4f13527f76a6. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:53:02 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407" returned: 0 in 1.631s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:02 devstack sudo[92652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc 1G
Jul 03 12:53:02 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:04 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc 1G" returned: 0 in 1.555s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49e26470-c797-47b3-a016-dc22a66c8407 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:04 devstack sudo[92661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49e26470-c797-47b3-a016-dc22a66c8407 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc
Jul 03 12:53:04 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:53:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:05 devstack sudo[92664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:53:05 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:05 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49e26470-c797-47b3-a016-dc22a66c8407 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc" returned: 0 in 1.692s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:05 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:53:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:05 devstack sudo[92669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc
Jul 03 12:53:05 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-99dc0ed1-2a48-44a6-bec5-ab8219eacafd req-901cbd4e-8750-4273-8833-84429cb5a116 tempest-AttachVolumeTestJSON-58977977 None] Terminate volume connection completed successfully.
Jul 03 12:53:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-99dc0ed1-2a48-44a6-bec5-ab8219eacafd req-901cbd4e-8750-4273-8833-84429cb5a116 tempest-AttachVolumeTestJSON-58977977 None] Deleting attachment 56be6952-dbd0-4962-819a-b88e8a318ae2. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:53:06 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.804s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:53:07 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc" returned: 0 in 1.307s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:07 devstack sudo[92678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.info
Jul 03 12:53:07 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:08 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.info" returned: 0 in 0.962s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:08 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:53:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:08 devstack sudo[92684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.info
Jul 03 12:53:08 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:09 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.info" returned: 0 in 0.994s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.331s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Creating offline snapshot b74a0818-8721-459d-a04d-e9a7fff529d6 of volume 4db47457-e620-424d-a144-a1c7fadc45d0 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:53:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-25c2b662-57e9-4edc-a8a0-ad42fc60b894 tempest-GroupSnapshotsV319Test-147345718 None] Group tempest-GroupSnapshotsV319Test-Group-248368725: creating
Jul 03 12:53:09 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc49baff-2023-4a84-9b57-0dd9984a3f5e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-25c2b662-57e9-4edc-a8a0-ad42fc60b894 tempest-GroupSnapshotsV319Test-147345718 None] Group tempest-GroupSnapshotsV319Test-Group-248368725: created successfully
Jul 03 12:53:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-25c2b662-57e9-4edc-a8a0-ad42fc60b894 tempest-GroupSnapshotsV319Test-147345718 None] Create group completed successfully.
Jul 03 12:53:09 devstack sudo[92687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0
Jul 03 12:53:09 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:10 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0" returned: 0 in 1.012s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:10 devstack sudo[92694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6 1G
Jul 03 12:53:10 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Flow 'volume_create_manager' (b08f5f7a-284b-4ce7-94eb-55687ee29f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfd55a4-cf91-4217-9b2a-a742bed409f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfd55a4-cf91-4217-9b2a-a742bed409f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611742099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b265eccb-9ae6-4695-ad05-0e37f1e70656,host='devstack@QuobyteHD#QuobyteHD',id=8eb83aa5-812c-4184-87c9-81d79661c194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00d6dd0818444ccaa99886e3d0bca18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:12Z,use_quota=True,user_id='dc6c80eed2a0497ba9edab3c435d45db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(772f3eb2-02f2-4b80-b85b-03c27eebdde8),volume_type_id=772f3eb2-02f2-4b80-b85b-03c27eebdde8)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2a4e66-88ec-48f3-8aa6-b2f60dbd9e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2a4e66-88ec-48f3-8aa6-b2f60dbd9e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132899f0-d486-4e5a-93c0-80d6ef07f072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132899f0-d486-4e5a-93c0-80d6ef07f072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb83aa5-812c-4184-87c9-81d79661c194', 'volume_name': 'volume-8eb83aa5-812c-4184-87c9-81d79661c194', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dfeb30-2eee-48a4-9942-d46da5684844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dfeb30-2eee-48a4-9942-d46da5684844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7db54b-6d3f-40cd-9cbc-539e8b777e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Volume 8eb83aa5-812c-4184-87c9-81d79661c194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb83aa5-812c-4184-87c9-81d79661c194', 'volume_size': 1}
Jul 03 12:53:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:12 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6 1G" returned: 0 in 1.830s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db47457-e620-424d-a144-a1c7fadc45d0 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:12 devstack sudo[92736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db47457-e620-424d-a144-a1c7fadc45d0 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6
Jul 03 12:53:12 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:13 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4db47457-e620-424d-a144-a1c7fadc45d0 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6" returned: 0 in 1.042s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:13 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:13 devstack sudo[92742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6
Jul 03 12:53:13 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:13 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6" returned: 0 in 0.797s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:14 devstack sudo[92746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.info
Jul 03 12:53:14 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:14 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.info" returned: 0 in 0.783s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:14 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:53:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:14 devstack sudo[92749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.info
Jul 03 12:53:14 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:15 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.info" returned: 0 in 0.817s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.463s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.688s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b265eccb-9ae6-4695-ad05-0e37f1e70656,created_at=2026-07-03T10:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611742099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b265eccb-9ae6-4695-ad05-0e37f1e70656,host='devstack@QuobyteHD#QuobyteHD',id=8eb83aa5-812c-4184-87c9-81d79661c194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00d6dd0818444ccaa99886e3d0bca18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:12Z,use_quota=True,user_id='dc6c80eed2a0497ba9edab3c435d45db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(772f3eb2-02f2-4b80-b85b-03c27eebdde8),volume_type_id=772f3eb2-02f2-4b80-b85b-03c27eebdde8)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Creating volume 8eb83aa5-812c-4184-87c9-81d79661c194 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:53:15 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:53:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:15 devstack sudo[92752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194 1073741824
Jul 03 12:53:15 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c6462060-96b5-4fc7-bba7-2da17b88665d tempest-GroupSnapshotsTest-1552653711 None] group_snapshot 2d1495b2-97b0-40ab-a78a-319930e2c518: created successfully
Jul 03 12:53:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] group_snapshot 2d1495b2-97b0-40ab-a78a-319930e2c518: deleting
Jul 03 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] group_snapshot 2d1495b2-97b0-40ab-a78a-319930e2c518: deleting {{(pid=86763) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-49e26470-c797-47b3-a016-dc22a66c8407" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-49e26470-c797-47b3-a016-dc22a66c8407" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-8f0ab3ab-5293-4477-8dc2-c8c926ff54fc" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-8f0ab3ab-5293-4477-8dc2-c8c926ff54fc" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Deleting offline snapshot 8f0ab3ab-5293-4477-8dc2-c8c926ff54fc of volume 49e26470-c797-47b3-a016-dc22a66c8407 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:53:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] snapshot_file for this snap is: volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:53:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0128cde-2830-43ea-ab9b-e4a66d15aef6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:16 devstack sudo[92791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc
Jul 03 12:53:16 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:17 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194 1073741824" returned: 0 in 1.447s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:17 devstack sudo[92794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194
Jul 03 12:53:17 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:17 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc" returned: 0 in 1.099s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49e26470-c797-47b3-a016-dc22a66c8407(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:53:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[204769d7-d434-45be-b80f-bef0ccb0a219]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:18 devstack sudo[92800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407
Jul 03 12:53:18 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:18 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194" returned: 0 in 0.919s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] <== create_volume: return (2429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:53:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.433s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7db54b-6d3f-40cd-9cbc-539e8b777e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb83aa5-812c-4184-87c9-81d79661c194', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888e96a0-242d-4856-8f02-dfd2edf858dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Volume volume-8eb83aa5-812c-4184-87c9-81d79661c194 (8eb83aa5-812c-4184-87c9-81d79661c194): created successfully
Jul 03 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888e96a0-242d-4856-8f02-dfd2edf858dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Flow 'volume_create_manager' (b08f5f7a-284b-4ce7-94eb-55687ee29f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:53:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b71de606-a30b-459a-9fd4-d9750a93a96a tempest-GroupSnapshotsV319Test-147345718 None] Created volume successfully.
Jul 03 12:53:18 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407" returned: 0 in 1.035s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:18 devstack sudo[92805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc
Jul 03 12:53:18 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "cinder-e8488d83-8e34-4345-95f1-7a32aab5a5ee-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-e8488d83-8e34-4345-95f1-7a32aab5a5ee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "cinder-quobyte-e8488d83-8e34-4345-95f1-7a32aab5a5ee" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-quobyte-e8488d83-8e34-4345-95f1-7a32aab5a5ee" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[578afdf4-a7c6-43f5-85ef-00eb0a676cdc]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:19 devstack sudo[92807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee
Jul 03 12:53:19 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] GroupSnapshot c62f1f85-4a21-4864-95e3-ad69c10ce35c: creating.
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] Group snapshot c62f1f85-4a21-4864-95e3-ad69c10ce35c: creating. {{(pid=86763) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] Creating offline snapshot 31cd3c38-cd4b-432b-8778-4b3ff375d01e of volume 8eb83aa5-812c-4184-87c9-81d79661c194 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[905f046a-9461-4af9-ae69-00a5f96e57e9]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:19 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc" returned: 0 in 1.003s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:19 devstack sudo[92817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc
Jul 03 12:53:19 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:19 devstack sudo[92813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194
Jul 03 12:53:19 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:20 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee" returned: 0 in 0.864s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:20 devstack sudo[92820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee
Jul 03 12:53:20 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:20 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407.8f0ab3ab-5293-4477-8dc2-c8c926ff54fc" returned: 0 in 0.771s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-8f0ab3ab-5293-4477-8dc2-c8c926ff54fc" released by "_delete_snapshot" :: held 4.053s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-49e26470-c797-47b3-a016-dc22a66c8407" released by "delete_snapshot" :: held 4.090s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:20 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:20 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e8488d83-8e34-4345-95f1-7a32aab5a5ee" returned: 0 in 0.709s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194" returned: 0 in 0.902s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-4db47457-e620-424d-a144-a1c7fadc45d0" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:20 devstack sudo[92827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e 1G
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-quobyte-e8488d83-8e34-4345-95f1-7a32aab5a5ee" released by "delete_volume" :: held 1.627s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:20 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-4db47457-e620-424d-a144-a1c7fadc45d0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-b74a0818-8721-459d-a04d-e9a7fff529d6" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-b74a0818-8721-459d-a04d-e9a7fff529d6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Deleting offline snapshot b74a0818-8721-459d-a04d-e9a7fff529d6 of volume 4db47457-e620-424d-a144-a1c7fadc45d0 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] snapshot_file for this snap is: volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[40535ead-12bc-47be-b844-685f8f9ea6df]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Created reservations ['f140bf38-bce3-43e2-9c3a-fe0976720602', 'ff3da512-bc8a-4330-9550-696cd01f8e01', '31488192-929f-42c6-8339-27de0782a74e', 'aae0759b-4dc2-4b9b-a255-2d7e4c65220e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:53:20 devstack sudo[92829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6
Jul 03 12:53:20 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:20 devstack sudo[92831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:53:20 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "cinder-920b0464-ab6d-45c3-a326-0b71cdeec47c-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-920b0464-ab6d-45c3-a326-0b71cdeec47c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "cinder-quobyte-920b0464-ab6d-45c3-a326-0b71cdeec47c" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-quobyte-920b0464-ab6d-45c3-a326-0b71cdeec47c" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[67249928-a535-4f3e-ba37-9b57686e026f]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:21 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c
Jul 03 12:53:21 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:21 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e 1G" returned: 0 in 1.084s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eb83aa5-812c-4184-87c9-81d79661c194 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:21 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.867s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:53:21 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6" returned: 0 in 1.019s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4db47457-e620-424d-a144-a1c7fadc45d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:53:21 devstack sudo[92843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eb83aa5-812c-4184-87c9-81d79661c194 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e
Jul 03 12:53:21 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Deleted volume successfully.
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c19b48-d078-471d-9fc2-1151aa3b1a5e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8501175a-0df0-45ca-a701-8be57eac8f87 tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-e8488d83-8e34-4345-95f1-7a32aab5a5ee-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:22 devstack sudo[92845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0
Jul 03 12:53:22 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:22 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c" returned: 0 in 0.939s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:22 devstack sudo[92850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c
Jul 03 12:53:22 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:22 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eb83aa5-812c-4184-87c9-81d79661c194 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e" returned: 0 in 0.881s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:22 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:22 devstack sudo[92858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e
Jul 03 12:53:22 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:22 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0" returned: 0 in 0.850s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:22 devstack sudo[92860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6
Jul 03 12:53:22 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:23 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-920b0464-ab6d-45c3-a326-0b71cdeec47c" returned: 0 in 0.759s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-quobyte-920b0464-ab6d-45c3-a326-0b71cdeec47c" released by "delete_volume" :: held 1.763s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Created reservations ['3ae178d3-878f-43cb-af96-216bf7d576a7', '90a82717-d4fc-4c88-a7a0-c130eeb9e9c4', '43b37b2b-8313-41c1-82e2-9e3be7b3de8c', 'acd7b54f-da3b-43be-b618-e7c05d1042f2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:23 devstack sudo[92867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:53:23 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:23 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e" returned: 0 in 0.828s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:23 devstack sudo[92869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.info
Jul 03 12:53:23 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:23 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6" returned: 0 in 1.010s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:23 devstack sudo[92871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6
Jul 03 12:53:23 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "cinder-b3eda60a-3afe-472c-a9a3-ec7b2081df1b-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-b3eda60a-3afe-472c-a9a3-ec7b2081df1b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "cinder-quobyte-b3eda60a-3afe-472c-a9a3-ec7b2081df1b" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-quobyte-b3eda60a-3afe-472c-a9a3-ec7b2081df1b" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:24 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d1a041-bb83-4384-a111-007cf1dab769]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:24 devstack sudo[92873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b
Jul 03 12:53:24 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:24 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.info" returned: 0 in 1.020s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:24 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:24 devstack sudo[92878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.info
Jul 03 12:53:24 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:24 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0.b74a0818-8721-459d-a04d-e9a7fff529d6" returned: 0 in 0.976s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:24 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-b74a0818-8721-459d-a04d-e9a7fff529d6" released by "_delete_snapshot" :: held 3.996s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.293s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-4db47457-e620-424d-a144-a1c7fadc45d0" released by "delete_snapshot" :: held 4.028s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:24 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Deleted volume successfully.
Jul 03 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5fe25c25-5c9a-4f08-890f-77f487d744aa tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-920b0464-ab6d-45c3-a326-0b71cdeec47c-delete_volume" released by "delete_volume" :: held 3.483s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:24 devstack cinder-volume[86763]: WARNING cinder.quota [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2125663611 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2125663611, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:53:24 devstack cinder-volume[86763]: WARNING cinder.quota [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2125663611 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2125663611, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:53:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['9fafaada-13be-4874-adf4-32ad3bc37377', '394c304a-af15-4aab-87e1-d9d55caa39ae', 'f551d13f-d511-4e99-86b7-500b58616001', '7ed7750e-206c-449b-9a86-fd61a165c727'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:25 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['5c6eee88-fc1c-42d7-9ca3-f98a37f2d8b8', '5422a581-1c81-4eaa-942f-502b2c30cbc1', '8f1dc6c9-689d-4f3d-a85f-7421181c6ccf', '6f9c8bf4-7e67-4d81-bb51-3b4e1e1102a6'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-86a1dea5-e766-48fb-af89-757941efc7f6 tempest-GroupSnapshotsTest-1552653711 None] group_snapshot 2d1495b2-97b0-40ab-a78a-319930e2c518: deleted successfully
Jul 03 12:53:25 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b" returned: 0 in 1.284s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:25 devstack sudo[92884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b
Jul 03 12:53:25 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:25 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.info" returned: 0 in 0.969s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.815s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5bb4e7f8-ab46-477d-b670-ea993046b24b tempest-GroupSnapshotsV319Test-147345718 None] group_snapshot c62f1f85-4a21-4864-95e3-ad69c10ce35c: created successfully
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-49e26470-c797-47b3-a016-dc22a66c8407" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-49e26470-c797-47b3-a016-dc22a66c8407" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d1440e-174d-40fc-8535-27d356f095af]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:26 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b3eda60a-3afe-472c-a9a3-ec7b2081df1b" returned: 0 in 0.799s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-quobyte-b3eda60a-3afe-472c-a9a3-ec7b2081df1b" released by "delete_volume" :: held 2.149s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=106,cinder:SELECT=121,cinder:INSERT=24,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=106,cinder:UPDATE=98,cinder:INSERT=23,cinder:DELETE=8 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Created reservations ['c1e2230e-a416-4735-867d-b478e35f1c1c', '055f23be-117d-429c-87c0-6cdf02aacc4d', '95a6e9bd-443b-427a-ba03-eb69f531e7a0', 'e55d765f-962e-4406-bf15-77fc07e8c047'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:26 devstack sudo[92888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407
Jul 03 12:53:26 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:26 devstack sudo[92890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:53:26 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] group_snapshot c62f1f85-4a21-4864-95e3-ad69c10ce35c: deleting
Jul 03 12:53:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] group_snapshot c62f1f85-4a21-4864-95e3-ad69c10ce35c: deleting {{(pid=86763) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Acquiring lock "cinder-quobyte-8eb83aa5-812c-4184-87c9-81d79661c194" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Lock "cinder-quobyte-8eb83aa5-812c-4184-87c9-81d79661c194" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Acquiring lock "cinder-quobyte-31cd3c38-cd4b-432b-8778-4b3ff375d01e" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Lock "cinder-quobyte-31cd3c38-cd4b-432b-8778-4b3ff375d01e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Deleting offline snapshot 31cd3c38-cd4b-432b-8778-4b3ff375d01e of volume 8eb83aa5-812c-4184-87c9-81d79661c194 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] snapshot_file for this snap is: volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d903f0c-7bc5-456b-a118-c3f0fdca2dc7]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:27 devstack sudo[92895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e
Jul 03 12:53:27 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:27 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407" returned: 0 in 1.450s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:27 devstack sudo[92900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407
Jul 03 12:53:27 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:27 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.248s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:53:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Deleted volume successfully.
Jul 03 12:53:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-eecfeaa8-d69a-4860-b649-c63344045b9a tempest-AttachVolumeTestJSON-58977977 None] Lock "cinder-b3eda60a-3afe-472c-a9a3-ec7b2081df1b-delete_volume" released by "delete_volume" :: held 3.915s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:28 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e" returned: 0 in 1.270s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8eb83aa5-812c-4184-87c9-81d79661c194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:53:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbc1600-becc-4ddc-a131-8fd7c281879c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:28 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-49e26470-c797-47b3-a016-dc22a66c8407" returned: 0 in 0.932s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-49e26470-c797-47b3-a016-dc22a66c8407" released by "delete_volume" :: held 2.470s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-4db47457-e620-424d-a144-a1c7fadc45d0" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-4db47457-e620-424d-a144-a1c7fadc45d0" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad00d22-0095-462b-89bc-bc4e2e47397d]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:28 devstack sudo[92910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194
Jul 03 12:53:28 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:28 devstack sudo[92911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0
Jul 03 12:53:28 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:29 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0" returned: 0 in 1.002s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:29 devstack sudo[92920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0
Jul 03 12:53:29 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:29 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194" returned: 0 in 1.175s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:29 devstack sudo[92923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e
Jul 03 12:53:29 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:30 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4db47457-e620-424d-a144-a1c7fadc45d0" returned: 0 in 1.011s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-4db47457-e620-424d-a144-a1c7fadc45d0" released by "delete_volume" :: held 2.112s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:30 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e" returned: 0 in 1.068s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:30 devstack sudo[92932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e
Jul 03 12:53:30 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['161faba4-5335-463e-a1a3-a6572526feea'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:30 devstack cinder-volume[86763]: WARNING cinder.quota [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2125663611 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2125663611, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:53:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['9ee5f72b-e0e5-4812-a2b7-7e8063eb538a', 'ba834bba-3e47-4073-83fe-680f7a5998c0', '9cb6d666-f280-4647-8211-9beb09badb92', 'ee7cdfa8-0ed2-427c-bab3-9c4b06cd97bb'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['d3ab0952-d209-437a-94a6-cedcd9f293a6', '6472b017-bf2e-41a1-9a34-3584af67d23e', 'b92b9ed3-1630-44b1-a0aa-15173d548d16', 'e29ce790-13c8-41e9-a0c8-1f87d530fadd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:31 devstack sudo[92942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:53:31 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-7b1787e8-09bb-4ea0-8dcd-989950c6dbb4 req-728c3f55-e222-4b58-9d33-ee9a695a80a4 tempest-ServerActionsTestOtherA-1688824323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-7b1787e8-09bb-4ea0-8dcd-989950c6dbb4 req-728c3f55-e222-4b58-9d33-ee9a695a80a4 tempest-ServerActionsTestOtherA-1688824323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafb72e6-2af0-4662-a1e5-60f2c3fdea42]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-7b1787e8-09bb-4ea0-8dcd-989950c6dbb4 req-728c3f55-e222-4b58-9d33-ee9a695a80a4 tempest-ServerActionsTestOtherA-1688824323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:31 devstack sudo[92944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b
Jul 03 12:53:31 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194.31cd3c38-cd4b-432b-8778-4b3ff375d01e" returned: 0 in 1.280s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:31 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Lock "cinder-quobyte-31cd3c38-cd4b-432b-8778-4b3ff375d01e" released by "_delete_snapshot" :: held 4.950s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Lock "cinder-quobyte-8eb83aa5-812c-4184-87c9-81d79661c194" released by "delete_snapshot" :: held 4.987s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:32 devstack cinder-volume[86763]: WARNING cinder.quota [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-314923615 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-314923615, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:53:32 devstack cinder-volume[86763]: WARNING cinder.quota [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-314923615 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-314923615, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:53:32 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] Created reservations ['f6e3e6ce-3957-4b97-97b7-95665ea9285c', '356f5680-1d0a-46ee-bc0a-8bf755c52997', '307bf8c5-2fcd-4a72-884e-f5cd4c74c9c4', 'cdeb6a5f-f2f7-4f74-8d36-2c4aae39ae2f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:32 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.062s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:32 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:53:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4042e718-6f45-4003-8ff3-2e4a370d2a42 tempest-GroupSnapshotsTest-1552653711 None] Delete group completed successfully.
Jul 03 12:53:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1bfe746a-a507-4e2c-813b-ad570d9fb6dc tempest-GroupSnapshotsV319Test-147345718 None] group_snapshot c62f1f85-4a21-4864-95e3-ad69c10ce35c: deleted successfully
Jul 03 12:53:32 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-7b1787e8-09bb-4ea0-8dcd-989950c6dbb4 req-728c3f55-e222-4b58-9d33-ee9a695a80a4 tempest-ServerActionsTestOtherA-1688824323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b" returned: 0 in 1.448s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-7b1787e8-09bb-4ea0-8dcd-989950c6dbb4 req-728c3f55-e222-4b58-9d33-ee9a695a80a4 tempest-ServerActionsTestOtherA-1688824323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.471s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-7b1787e8-09bb-4ea0-8dcd-989950c6dbb4 req-728c3f55-e222-4b58-9d33-ee9a695a80a4 tempest-ServerActionsTestOtherA-1688824323 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-6a55196c-572a-412f-b18c-df373d3a4b3b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77bcde35-05ea-419e-9c3d-05ca73a48ac2', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:53:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6f04f59f-8e82-4130-baa6-bfb1f7c964e0 tempest-GroupSnapshotsTest-1552653711 None] Group tempest-GroupSnapshotsTest-Group-520966948: creating
Jul 03 12:53:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6f04f59f-8e82-4130-baa6-bfb1f7c964e0 tempest-GroupSnapshotsTest-1552653711 None] Group tempest-GroupSnapshotsTest-Group-520966948: created successfully
Jul 03 12:53:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6f04f59f-8e82-4130-baa6-bfb1f7c964e0 tempest-GroupSnapshotsTest-1552653711 None] Create group completed successfully.
Jul 03 12:53:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-7b1787e8-09bb-4ea0-8dcd-989950c6dbb4 req-728c3f55-e222-4b58-9d33-ee9a695a80a4 tempest-ServerActionsTestOtherA-1688824323 None] attachment_update completed successfully.
Jul 03 12:53:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Acquiring lock "cinder-quobyte-8eb83aa5-812c-4184-87c9-81d79661c194" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Lock "cinder-quobyte-8eb83aa5-812c-4184-87c9-81d79661c194" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f231cc-956b-4e24-ba51-e203e28cbdbd]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:33 devstack sudo[92953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194
Jul 03 12:53:33 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Flow 'volume_create_manager' (3d1525de-0a48-4a25-9a79-dbc110be7c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0646f3fa-4e36-4a11-8c24-60ad68bbae4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0646f3fa-4e36-4a11-8c24-60ad68bbae4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1692252143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7dded1a7-111c-46aa-b080-02316b23ec2f,host='devstack@QuobyteHD#QuobyteHD',id=429f2e9e-0374-40cc-97a6-198e6388bb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141facd45fe4c05afa32eb122fb0628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:34Z,use_quota=True,user_id='b1859bffef1a428eb206bf23b0126277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59fa3b28-6cee-42ca-9ae0-15cffb520aa6),volume_type_id=59fa3b28-6cee-42ca-9ae0-15cffb520aa6)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313481ab-0ca5-432a-9e29-5ce7cf656948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313481ab-0ca5-432a-9e29-5ce7cf656948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab54e6b-f490-4838-98b5-72e1c03494b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab54e6b-f490-4838-98b5-72e1c03494b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429f2e9e-0374-40cc-97a6-198e6388bb67', 'volume_name': 'volume-429f2e9e-0374-40cc-97a6-198e6388bb67', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fbf20af-4016-4ffa-882e-6abab39cf73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fbf20af-4016-4ffa-882e-6abab39cf73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9e9254-400e-4321-ba6e-8e3352af5296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Volume 429f2e9e-0374-40cc-97a6-198e6388bb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429f2e9e-0374-40cc-97a6-198e6388bb67', 'volume_size': 1}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7dded1a7-111c-46aa-b080-02316b23ec2f,created_at=2026-07-03T10:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1692252143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7dded1a7-111c-46aa-b080-02316b23ec2f,host='devstack@QuobyteHD#QuobyteHD',id=429f2e9e-0374-40cc-97a6-198e6388bb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141facd45fe4c05afa32eb122fb0628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:53:34Z,use_quota=True,user_id='b1859bffef1a428eb206bf23b0126277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59fa3b28-6cee-42ca-9ae0-15cffb520aa6),volume_type_id=59fa3b28-6cee-42ca-9ae0-15cffb520aa6)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Creating volume 429f2e9e-0374-40cc-97a6-198e6388bb67 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:53:34 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:34 devstack sudo[93336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67 1073741824
Jul 03 12:53:34 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:34 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194" returned: 0 in 1.445s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:34 devstack sudo[93341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194
Jul 03 12:53:34 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:35 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67 1073741824" returned: 0 in 1.129s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:35 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eb83aa5-812c-4184-87c9-81d79661c194" returned: 0 in 0.860s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:35 devstack sudo[93348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67
Jul 03 12:53:35 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Lock "cinder-quobyte-8eb83aa5-812c-4184-87c9-81d79661c194" released by "delete_volume" :: held 2.430s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Created reservations ['301e07ff-886f-4d29-a36c-76bbb2d4c2d1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:35 devstack cinder-volume[86763]: WARNING cinder.quota [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-314923615 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-314923615, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:53:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Created reservations ['7b4ecce0-e1ee-4fe7-a9f7-c59b51c78348', 'b21f4b6c-fc89-4e50-bc2e-efd831a0369e', 'd8461dc8-abfd-4021-a00c-57cd3297840c', '094818b3-1465-43c1-a044-27e692467fd8'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:36 devstack sudo[93350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:53:36 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:36 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67" returned: 0 in 0.909s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9e9254-400e-4321-ba6e-8e3352af5296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429f2e9e-0374-40cc-97a6-198e6388bb67', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d5d233-9783-4af0-a467-f845c91078ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:53:36 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Volume volume-429f2e9e-0374-40cc-97a6-198e6388bb67 (429f2e9e-0374-40cc-97a6-198e6388bb67): created successfully
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d5d233-9783-4af0-a467-f845c91078ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:53:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Flow 'volume_create_manager' (3d1525de-0a48-4a25-9a79-dbc110be7c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:53:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-51a0fc0d-0581-4d6d-9832-8294444544ab tempest-GroupSnapshotsTest-1552653711 None] Created volume successfully.
Jul 03 12:53:37 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.079s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:53:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a8497072-9737-4db1-8ea1-3ca467f2d2d3 tempest-GroupSnapshotsV319Test-147345718 None] Delete group completed successfully.
Jul 03 12:53:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] GroupSnapshot 80a33f68-26b9-4a4a-8aef-c09498552e6f: creating.
Jul 03 12:53:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] Group snapshot 80a33f68-26b9-4a4a-8aef-c09498552e6f: creating. {{(pid=86763) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] Creating offline snapshot 05630c27-bbb6-4e49-953a-2a356652c470 of volume 429f2e9e-0374-40cc-97a6-198e6388bb67 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:53:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4957609-fc01-4387-9997-cb39c96df603]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:39 devstack sudo[93381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67
Jul 03 12:53:39 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:40 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67" returned: 0 in 1.308s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:40 devstack sudo[93395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470 1G
Jul 03 12:53:40 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:41 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470 1G" returned: 0 in 1.236s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429f2e9e-0374-40cc-97a6-198e6388bb67 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:41 devstack sudo[93406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429f2e9e-0374-40cc-97a6-198e6388bb67 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470
Jul 03 12:53:41 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-a6539952-e971-49ca-b52c-fffad11079ad req-4bbe40bd-e43e-44c7-ab74-08890ecb54e9 tempest-ServerActionsTestOtherA-1688824323 None] Terminate volume connection completed successfully.
Jul 03 12:53:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-a6539952-e971-49ca-b52c-fffad11079ad req-4bbe40bd-e43e-44c7-ab74-08890ecb54e9 tempest-ServerActionsTestOtherA-1688824323 None] Deleting attachment 77bcde35-05ea-419e-9c3d-05ca73a48ac2. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:53:42 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429f2e9e-0374-40cc-97a6-198e6388bb67 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470" returned: 0 in 1.189s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:42 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:53:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:42 devstack sudo[93467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470
Jul 03 12:53:42 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:43 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470" returned: 0 in 1.051s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:43 devstack sudo[93472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.info
Jul 03 12:53:43 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:44 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.info" returned: 0 in 1.053s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:44 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:44 devstack sudo[93475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.info
Jul 03 12:53:44 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-a6539952-e971-49ca-b52c-fffad11079ad req-21e2ad5d-3390-446d-9e24-88b2b0f4ce95 tempest-ServerActionsTestOtherA-1688824323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:45 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.info" returned: 0 in 0.817s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.785s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-a6539952-e971-49ca-b52c-fffad11079ad req-21e2ad5d-3390-446d-9e24-88b2b0f4ce95 tempest-ServerActionsTestOtherA-1688824323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.559s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:45 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f981362-c2d1-4c18-9a78-4a7e75d4dc52]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-a6539952-e971-49ca-b52c-fffad11079ad req-21e2ad5d-3390-446d-9e24-88b2b0f4ce95 tempest-ServerActionsTestOtherA-1688824323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-58665ea3-79c1-4334-8e4c-b08941909886 tempest-GroupSnapshotsTest-1552653711 None] group_snapshot 80a33f68-26b9-4a4a-8aef-c09498552e6f: created successfully
Jul 03 12:53:45 devstack sudo[93486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b
Jul 03 12:53:45 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] group_snapshot 80a33f68-26b9-4a4a-8aef-c09498552e6f: deleting
Jul 03 12:53:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] group_snapshot 80a33f68-26b9-4a4a-8aef-c09498552e6f: deleting {{(pid=86763) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 12:53:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-429f2e9e-0374-40cc-97a6-198e6388bb67" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-429f2e9e-0374-40cc-97a6-198e6388bb67" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-05630c27-bbb6-4e49-953a-2a356652c470" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-05630c27-bbb6-4e49-953a-2a356652c470" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Deleting offline snapshot 05630c27-bbb6-4e49-953a-2a356652c470 of volume 429f2e9e-0374-40cc-97a6-198e6388bb67 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:53:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] snapshot_file for this snap is: volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:53:46 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e19344-ecf1-41dd-84ed-38b82cfa8fa1]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:47 devstack sudo[93525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470
Jul 03 12:53:47 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:47 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-a6539952-e971-49ca-b52c-fffad11079ad req-21e2ad5d-3390-446d-9e24-88b2b0f4ce95 tempest-ServerActionsTestOtherA-1688824323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b" returned: 0 in 1.545s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-a6539952-e971-49ca-b52c-fffad11079ad req-21e2ad5d-3390-446d-9e24-88b2b0f4ce95 tempest-ServerActionsTestOtherA-1688824323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.578s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-a6539952-e971-49ca-b52c-fffad11079ad req-21e2ad5d-3390-446d-9e24-88b2b0f4ce95 tempest-ServerActionsTestOtherA-1688824323 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-6a55196c-572a-412f-b18c-df373d3a4b3b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '614217f3-a712-4192-a41d-1869325185de', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:53:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-a6539952-e971-49ca-b52c-fffad11079ad req-21e2ad5d-3390-446d-9e24-88b2b0f4ce95 tempest-ServerActionsTestOtherA-1688824323 None] attachment_update completed successfully.
Jul 03 12:53:48 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470" returned: 0 in 1.225s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-429f2e9e-0374-40cc-97a6-198e6388bb67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:53:48 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8934b0-bf4d-45de-953a-fff50654b297]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:48 devstack sudo[93533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67
Jul 03 12:53:48 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:49 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67" returned: 0 in 1.321s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:49 devstack sudo[93540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470
Jul 03 12:53:49 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:50 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470" returned: 0 in 1.113s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:50 devstack sudo[93560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470
Jul 03 12:53:50 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:51 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67.05630c27-bbb6-4e49-953a-2a356652c470" returned: 0 in 1.101s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-05630c27-bbb6-4e49-953a-2a356652c470" released by "_delete_snapshot" :: held 5.015s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-429f2e9e-0374-40cc-97a6-198e6388bb67" released by "delete_snapshot" :: held 5.067s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:52 devstack cinder-volume[86763]: WARNING cinder.quota [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1513426834 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1513426834, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:53:52 devstack cinder-volume[86763]: WARNING cinder.quota [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1513426834 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1513426834, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:53:52 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['de2a9e86-7be5-481c-89ee-d565a5464a17', 'cfb55055-53dd-4e88-8e62-ed4637aaae49', 'c38c4937-1a93-44a7-8981-1798339a5bd2', 'a7d00520-b3b1-4a37-b9e7-4eba9aa7d570'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-abd5f154-8f55-4559-a3e4-b50b799e844e tempest-GroupSnapshotsTest-1552653711 None] group_snapshot 80a33f68-26b9-4a4a-8aef-c09498552e6f: deleted successfully
Jul 03 12:53:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "cinder-quobyte-429f2e9e-0374-40cc-97a6-198e6388bb67" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:53:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-429f2e9e-0374-40cc-97a6-198e6388bb67" acquired by "delete_volume" :: waited 0.046s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:53:53 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef1b757-60f5-47e5-9daa-67dbd4ca8585]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:53:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:53 devstack sudo[93633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67
Jul 03 12:53:53 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:54 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67" returned: 0 in 1.517s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:54 devstack sudo[93988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67
Jul 03 12:53:54 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-429f2e9e-0374-40cc-97a6-198e6388bb67" returned: 0 in 1.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:55 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Lock "cinder-quobyte-429f2e9e-0374-40cc-97a6-198e6388bb67" released by "delete_volume" :: held 2.985s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:53:56 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['8254b9ea-4aa4-49ea-90fa-5c444e894955'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:56 devstack cinder-volume[86763]: WARNING cinder.quota [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1513426834 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1513426834, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:53:56 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Created reservations ['5fbdaaed-da28-477b-be42-19b4fee527f2', '51b528df-98c5-449a-8f63-1f4bbc2d08bf', '3d18f93f-e50e-41da-a48f-f7253e16e6bd', 'f2ae5e17-1dce-4b03-a257-1ba0d88d525a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:53:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:53:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:53:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:53:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:53:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:53:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:56 devstack sudo[93994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:53:56 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:57 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.432s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:57 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:53:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f305c599-525b-4b40-b841-a05591742a87 tempest-GroupSnapshotsTest-1552653711 None] Delete group completed successfully.
Jul 03 12:54:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ae97a319-73b5-43ab-90d6-dad69677a070 tempest-GroupsTest-778940272 None] Group tempest-Group1-905107259: creating
Jul 03 12:54:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ae97a319-73b5-43ab-90d6-dad69677a070 tempest-GroupsTest-778940272 None] Group tempest-Group1-905107259: created successfully
Jul 03 12:54:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ae97a319-73b5-43ab-90d6-dad69677a070 tempest-GroupsTest-778940272 None] Create group completed successfully.
Jul 03 12:54:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-eea28c22-edbe-4192-af63-7a3edfc3f886 tempest-GroupsTest-778940272 None] Group tempest-Group2-1474177040: creating
Jul 03 12:54:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-eea28c22-edbe-4192-af63-7a3edfc3f886 tempest-GroupsTest-778940272 None] Group tempest-Group2-1474177040: created successfully
Jul 03 12:54:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-eea28c22-edbe-4192-af63-7a3edfc3f886 tempest-GroupsTest-778940272 None] Create group completed successfully.
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Flow 'volume_create_manager' (b9b6dd7b-ff59-4ac9-a45e-0b9a48e830f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6b521b-16fd-40ad-9b62-d4f63b2adb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6b521b-16fd-40ad-9b62-d4f63b2adb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1780565565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5f79055d-161a-47aa-9f84-481ffcc5892f,host='devstack@QuobyteHD#QuobyteHD',id=32da7e6c-576e-42f9-80ca-32f7d71fdd04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a979734a500e4fa1a8d6cea578d4526f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:04Z,use_quota=True,user_id='6ec5f981cc5749249a56b8e31d8c06fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2dc05c-858b-4eba-a36d-4fdcad924e89),volume_type_id=ca2dc05c-858b-4eba-a36d-4fdcad924e89)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce77c37b-1904-44fd-b7b8-1849584d4bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce77c37b-1904-44fd-b7b8-1849584d4bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1bb7ef-3bf2-46b9-add4-e0966eae2dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1bb7ef-3bf2-46b9-add4-e0966eae2dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32da7e6c-576e-42f9-80ca-32f7d71fdd04', 'volume_name': 'volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74179a87-081f-409a-a3c5-027bd4bc5ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74179a87-081f-409a-a3c5-027bd4bc5ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb3bceb-2821-4705-86e8-3b6f1ade75ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Volume 32da7e6c-576e-42f9-80ca-32f7d71fdd04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04', 'volume_size': 1}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5f79055d-161a-47aa-9f84-481ffcc5892f,created_at=2026-07-03T10:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1780565565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5f79055d-161a-47aa-9f84-481ffcc5892f,host='devstack@QuobyteHD#QuobyteHD',id=32da7e6c-576e-42f9-80ca-32f7d71fdd04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a979734a500e4fa1a8d6cea578d4526f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:04Z,use_quota=True,user_id='6ec5f981cc5749249a56b8e31d8c06fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca2dc05c-858b-4eba-a36d-4fdcad924e89),volume_type_id=ca2dc05c-858b-4eba-a36d-4fdcad924e89)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Creating volume 32da7e6c-576e-42f9-80ca-32f7d71fdd04 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:54:04 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:54:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:04 devstack sudo[94014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04 1073741824
Jul 03 12:54:04 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:05 devstack sudo[94016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:54:05 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:05 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04 1073741824" returned: 0 in 1.347s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:05 devstack sudo[94022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04
Jul 03 12:54:05 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:05 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.968s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:54:06 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04" returned: 0 in 1.147s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] <== create_volume: return (2557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:54:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.560s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb3bceb-2821-4705-86e8-3b6f1ade75ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0973cbd9-3130-49e3-b8df-071829ddb857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:06 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Volume volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04 (32da7e6c-576e-42f9-80ca-32f7d71fdd04): created successfully
Jul 03 12:54:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0973cbd9-3130-49e3-b8df-071829ddb857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Flow 'volume_create_manager' (b9b6dd7b-ff59-4ac9-a45e-0b9a48e830f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-12a1a482-12b1-401c-bc42-2e0f41d00cc9 tempest-GroupsTest-778940272 None] Created volume successfully.
Jul 03 12:54:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Acquiring lock "cinder-quobyte-32da7e6c-576e-42f9-80ca-32f7d71fdd04" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:54:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Lock "cinder-quobyte-32da7e6c-576e-42f9-80ca-32f7d71fdd04" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:54:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f563be3-2f5e-4d5f-a9c4-503561fb626d]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:54:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:09 devstack sudo[94026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04
Jul 03 12:54:09 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:10 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04" returned: 0 in 1.593s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:10 devstack sudo[94088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04
Jul 03 12:54:10 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:11 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-32da7e6c-576e-42f9-80ca-32f7d71fdd04" returned: 0 in 1.068s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Lock "cinder-quobyte-32da7e6c-576e-42f9-80ca-32f7d71fdd04" released by "delete_volume" :: held 2.792s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Created reservations ['335248f6-3dcb-4475-af15-d00a6b8bf526'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:54:11 devstack cinder-volume[86763]: WARNING cinder.quota [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-898729866 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-898729866, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:54:11 devstack cinder-volume[86763]: WARNING cinder.quota [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-898729866 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-898729866, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:54:11 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Created reservations ['7ae13f78-4f62-4b30-afe7-ec50247ca477', 'b74483dd-25e1-4c49-8c36-c2792eb1c234', '64c024d8-b788-4c5c-8ee8-c0217562652b', '0d624b9e-e90f-4beb-bd54-344215315340'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:54:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:12 devstack sudo[94116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:54:12 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:12 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.957s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:12 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:54:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-258e01bb-90ca-4211-ba58-1b180a8e3ea3 tempest-GroupsTest-778940272 None] Delete group completed successfully.
Jul 03 12:54:13 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-02acf457-9ba9-49b3-bac4-5afd9060e0da tempest-GroupsTest-778940272 None] Created reservations ['1baf8f6b-07d9-484a-9cdc-476cefc7578d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:54:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-02acf457-9ba9-49b3-bac4-5afd9060e0da tempest-GroupsTest-778940272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-02acf457-9ba9-49b3-bac4-5afd9060e0da tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-02acf457-9ba9-49b3-bac4-5afd9060e0da tempest-GroupsTest-778940272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-02acf457-9ba9-49b3-bac4-5afd9060e0da tempest-GroupsTest-778940272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-02acf457-9ba9-49b3-bac4-5afd9060e0da tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-02acf457-9ba9-49b3-bac4-5afd9060e0da tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:13 devstack sudo[94119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:54:13 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:14 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-02acf457-9ba9-49b3-bac4-5afd9060e0da tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.810s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:14 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-02acf457-9ba9-49b3-bac4-5afd9060e0da tempest-GroupsTest-778940272 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:54:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-02acf457-9ba9-49b3-bac4-5afd9060e0da tempest-GroupsTest-778940272 None] Delete group completed successfully.
Jul 03 12:54:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e73bb723-3971-45b7-8446-0bb839c3e1ed tempest-GroupsTest-778940272 None] Group tempest-GroupsTest-Group-416302035: creating
Jul 03 12:54:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e73bb723-3971-45b7-8446-0bb839c3e1ed tempest-GroupsTest-778940272 None] Group tempest-GroupsTest-Group-416302035: created successfully
Jul 03 12:54:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e73bb723-3971-45b7-8446-0bb839c3e1ed tempest-GroupsTest-778940272 None] Create group completed successfully.
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Flow 'volume_create_manager' (8b03cee8-6427-4017-b8c6-870501560e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d6ea98-abdb-4efc-a1f9-274ec0599df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d6ea98-abdb-4efc-a1f9-274ec0599df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1927601014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a0b3655-71e7-4041-b16d-24fd2e2f4963,host='devstack@QuobyteHD#QuobyteHD',id=a24f8494-f843-43d0-8252-026168fc6229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a979734a500e4fa1a8d6cea578d4526f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:17Z,use_quota=True,user_id='6ec5f981cc5749249a56b8e31d8c06fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4594b5ca-0a4c-415e-86ce-13503ba415b3),volume_type_id=4594b5ca-0a4c-415e-86ce-13503ba415b3)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb76014-62a8-4c5b-aa9a-d0758182ce8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb76014-62a8-4c5b-aa9a-d0758182ce8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607092f1-3d38-4d04-aae0-b782cbacaa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607092f1-3d38-4d04-aae0-b782cbacaa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24f8494-f843-43d0-8252-026168fc6229', 'volume_name': 'volume-a24f8494-f843-43d0-8252-026168fc6229', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcad1019-7baf-4b4f-a221-b03c352b36ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcad1019-7baf-4b4f-a221-b03c352b36ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c72aca-e98e-453b-9aaa-17cb9c639be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:16 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Volume a24f8494-f843-43d0-8252-026168fc6229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24f8494-f843-43d0-8252-026168fc6229', 'volume_size': 1}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5a0b3655-71e7-4041-b16d-24fd2e2f4963,created_at=2026-07-03T10:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1927601014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a0b3655-71e7-4041-b16d-24fd2e2f4963,host='devstack@QuobyteHD#QuobyteHD',id=a24f8494-f843-43d0-8252-026168fc6229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a979734a500e4fa1a8d6cea578d4526f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:17Z,use_quota=True,user_id='6ec5f981cc5749249a56b8e31d8c06fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4594b5ca-0a4c-415e-86ce-13503ba415b3),volume_type_id=4594b5ca-0a4c-415e-86ce-13503ba415b3)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Creating volume a24f8494-f843-43d0-8252-026168fc6229 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:54:16 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:54:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:16 devstack sudo[94150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229 1073741824
Jul 03 12:54:16 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:18 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229 1073741824" returned: 0 in 1.720s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:18 devstack sudo[94199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229
Jul 03 12:54:18 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:19 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229" returned: 0 in 1.308s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] <== create_volume: return (3119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:54:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.122s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c72aca-e98e-453b-9aaa-17cb9c639be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24f8494-f843-43d0-8252-026168fc6229', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e89948-5081-41c6-b6a0-ddb1e019780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:20 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Volume volume-a24f8494-f843-43d0-8252-026168fc6229 (a24f8494-f843-43d0-8252-026168fc6229): created successfully
Jul 03 12:54:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e89948-5081-41c6-b6a0-ddb1e019780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Flow 'volume_create_manager' (8b03cee8-6427-4017-b8c6-870501560e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0aef23ea-45a6-494d-9207-a42097ccffa0 tempest-GroupsTest-778940272 None] Created volume successfully.
Jul 03 12:54:21 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Flow 'volume_create_manager' (dd9c8357-5984-4c02-a3a2-6d8c2cc42bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3ede74-576e-4fca-a26c-420b78fa7ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3ede74-576e-4fca-a26c-420b78fa7ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-716132834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a0b3655-71e7-4041-b16d-24fd2e2f4963,host='devstack@QuobyteHD#QuobyteHD',id=6ca3b065-8ae3-4557-a0d2-1517ccc28567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a979734a500e4fa1a8d6cea578d4526f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:22Z,use_quota=True,user_id='6ec5f981cc5749249a56b8e31d8c06fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4594b5ca-0a4c-415e-86ce-13503ba415b3),volume_type_id=4594b5ca-0a4c-415e-86ce-13503ba415b3)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c543b6-1df2-460b-8aca-e8d794ed5c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c543b6-1df2-460b-8aca-e8d794ed5c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954a984d-fc84-416d-a6a0-6dd6a2c2ef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954a984d-fc84-416d-a6a0-6dd6a2c2ef89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca3b065-8ae3-4557-a0d2-1517ccc28567', 'volume_name': 'volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605499e9-b023-4c77-aaec-7dd6ba4a61b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605499e9-b023-4c77-aaec-7dd6ba4a61b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb584f8-de60-4512-95a2-45c15144283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:22 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Volume 6ca3b065-8ae3-4557-a0d2-1517ccc28567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567', 'volume_size': 1}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5a0b3655-71e7-4041-b16d-24fd2e2f4963,created_at=2026-07-03T10:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-716132834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a0b3655-71e7-4041-b16d-24fd2e2f4963,host='devstack@QuobyteHD#QuobyteHD',id=6ca3b065-8ae3-4557-a0d2-1517ccc28567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a979734a500e4fa1a8d6cea578d4526f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:22Z,use_quota=True,user_id='6ec5f981cc5749249a56b8e31d8c06fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4594b5ca-0a4c-415e-86ce-13503ba415b3),volume_type_id=4594b5ca-0a4c-415e-86ce-13503ba415b3)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Creating volume 6ca3b065-8ae3-4557-a0d2-1517ccc28567 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:54:22 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:54:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:22 devstack sudo[94206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567 1073741824
Jul 03 12:54:22 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:23 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567 1073741824" returned: 0 in 1.367s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:23 devstack sudo[94214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567
Jul 03 12:54:23 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:24 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-5a396923-05eb-43db-8ad6-3b85aeb3d0b9 req-09e9f5bf-3e3e-4771-8b5b-a0cad8508db5 tempest-ServerActionsTestOtherA-1688824323 None] Terminate volume connection completed successfully.
Jul 03 12:54:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-5a396923-05eb-43db-8ad6-3b85aeb3d0b9 req-09e9f5bf-3e3e-4771-8b5b-a0cad8508db5 tempest-ServerActionsTestOtherA-1688824323 None] Deleting attachment 614217f3-a712-4192-a41d-1869325185de. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:54:24 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567" returned: 0 in 1.201s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] <== create_volume: return (2678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:54:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.681s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb584f8-de60-4512-95a2-45c15144283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25364cf0-bc36-4d89-9aa7-fea315f19d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Volume volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567 (6ca3b065-8ae3-4557-a0d2-1517ccc28567): created successfully
Jul 03 12:54:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25364cf0-bc36-4d89-9aa7-fea315f19d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Flow 'volume_create_manager' (dd9c8357-5984-4c02-a3a2-6d8c2cc42bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2dbbbdbd-2a8b-400b-b92a-8e18b345c1dc tempest-GroupsTest-778940272 None] Created volume successfully.
Jul 03 12:54:26 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=97,cinder:INSERT=21,cinder:UPDATE=94,cinder:DELETE=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:54:26 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=96,cinder:INSERT=21,cinder:UPDATE=94,cinder:DELETE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:54:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0a424e31-faec-42c2-adb7-84c657d0ffb1 tempest-GroupsTest-778940272 None] Update group completed successfully.
Jul 03 12:54:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f53111f6-f033-47c9-86d5-131d577f7499 tempest-GroupsTest-778940272 None] Update group completed successfully.
Jul 03 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Acquiring lock "cinder-quobyte-6ca3b065-8ae3-4557-a0d2-1517ccc28567" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:54:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Lock "cinder-quobyte-6ca3b065-8ae3-4557-a0d2-1517ccc28567" acquired by "delete_volume" :: waited 0.040s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:54:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5d6137-7de2-4e8b-815b-7fb6f1a711d0]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:54:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:31 devstack sudo[94279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567
Jul 03 12:54:31 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:32 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567" returned: 0 in 1.256s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:32 devstack sudo[94314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567
Jul 03 12:54:32 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Flow 'volume_create_manager' (ce0fa37c-34de-4778-b92a-4a6273bcd199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c6b881-ad59-4d27-8825-2e30c5772773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:33 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6ca3b065-8ae3-4557-a0d2-1517ccc28567" returned: 0 in 0.917s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c6b881-ad59-4d27-8825-2e30c5772773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1950894527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862749e3-bf20-4646-aa96-4eb84a014095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000b5e505f554153a2e1f1ca014c4329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:34Z,use_quota=True,user_id='ca078e90e9ee48328ec5f4ac7165146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fd833d-79b9-45b3-a752-0aa141997e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fd833d-79b9-45b3-a752-0aa141997e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2517f98-2eab-4ac9-b20a-0280d4f9b5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2517f98-2eab-4ac9-b20a-0280d4f9b5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '862749e3-bf20-4646-aa96-4eb84a014095', 'volume_name': 'volume-862749e3-bf20-4646-aa96-4eb84a014095', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e78f8f4-f128-435e-81ee-795ad8161386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e78f8f4-f128-435e-81ee-795ad8161386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926dadd9-6381-4929-a024-f0fad470d8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:33 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Volume 862749e3-bf20-4646-aa96-4eb84a014095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-862749e3-bf20-4646-aa96-4eb84a014095', 'volume_size': 1}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1950894527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862749e3-bf20-4646-aa96-4eb84a014095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000b5e505f554153a2e1f1ca014c4329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:34Z,use_quota=True,user_id='ca078e90e9ee48328ec5f4ac7165146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Creating volume 862749e3-bf20-4646-aa96-4eb84a014095 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:54:33 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Lock "cinder-quobyte-6ca3b065-8ae3-4557-a0d2-1517ccc28567" released by "delete_volume" :: held 2.310s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Acquiring lock "cinder-quobyte-a24f8494-f843-43d0-8252-026168fc6229" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:54:33 devstack sudo[94317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095 1073741824
Jul 03 12:54:33 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Lock "cinder-quobyte-a24f8494-f843-43d0-8252-026168fc6229" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fd4be6-33f5-4f30-8870-cbd7189047bd]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:54:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:34 devstack sudo[94319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229
Jul 03 12:54:34 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:34 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229" returned: 0 in 0.992s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:35 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095 1073741824" returned: 0 in 1.089s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:35 devstack sudo[94329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229
Jul 03 12:54:35 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:35 devstack sudo[94331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095
Jul 03 12:54:35 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:35 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a24f8494-f843-43d0-8252-026168fc6229" returned: 0 in 0.776s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Lock "cinder-quobyte-a24f8494-f843-43d0-8252-026168fc6229" released by "delete_volume" :: held 1.824s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Created reservations ['3fc3a981-e865-4ddf-b375-5d0aee531ec3'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:54:35 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095" returned: 0 in 0.873s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:35 devstack cinder-volume[86763]: WARNING cinder.quota [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1140161870 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1140161870, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:54:35 devstack cinder-volume[86763]: WARNING cinder.quota [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1140161870 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1140161870, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926dadd9-6381-4929-a024-f0fad470d8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-862749e3-bf20-4646-aa96-4eb84a014095', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0037e641-54d2-4e3f-9289-f21023d2d2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Volume volume-862749e3-bf20-4646-aa96-4eb84a014095 (862749e3-bf20-4646-aa96-4eb84a014095): created successfully
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0037e641-54d2-4e3f-9289-f21023d2d2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Flow 'volume_create_manager' (ce0fa37c-34de-4778-b92a-4a6273bcd199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Created reservations ['140dd832-822a-45de-b1bc-cc6c4ef18958', '5ed8e74c-a63f-4cb5-8c55-544f9cc903a4', '364ee296-43ca-4d93-968b-c0398d44ad05', '2c250cf7-065f-4a60-9187-95cee254c2b6'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:54:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-88be38da-c13c-4b21-a540-1fe9c2f79d02 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Created volume successfully.
Jul 03 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Created reservations ['b565902d-6a53-4930-b855-011c35f98357', '93f9e51e-572e-4708-b078-85151d0c3861', 'd5a3006c-5b3c-4f87-aac3-1bc0a61d0380', '55598f0c-ec54-44a6-8120-da10f08ebc0f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:36 devstack sudo[94335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:54:36 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:37 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Acquiring lock "cinder-6a55196c-572a-412f-b18c-df373d3a4b3b-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.818s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:54:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dac5416b-2e31-4f0b-acf3-b179e8562db6 tempest-GroupsTest-778940272 None] Delete group completed successfully.
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Lock "cinder-6a55196c-572a-412f-b18c-df373d3a4b3b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Acquiring lock "cinder-quobyte-6a55196c-572a-412f-b18c-df373d3a4b3b" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Lock "cinder-quobyte-6a55196c-572a-412f-b18c-df373d3a4b3b" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Acquiring lock "cinder-862749e3-bf20-4646-aa96-4eb84a014095-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a46c65-172b-46a9-aed5-e702f13384a0]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "cinder-862749e3-bf20-4646-aa96-4eb84a014095-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Acquiring lock "cinder-quobyte-862749e3-bf20-4646-aa96-4eb84a014095" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "cinder-quobyte-862749e3-bf20-4646-aa96-4eb84a014095" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2addf0bd-092b-455d-8b3e-cd425e3b0615]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:54:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:37 devstack sudo[94338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b
Jul 03 12:54:37 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:37 devstack sudo[94339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095
Jul 03 12:54:37 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:38 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095" returned: 0 in 0.960s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:38 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b" returned: 0 in 1.097s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:38 devstack sudo[94349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095
Jul 03 12:54:38 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:38 devstack sudo[94350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b
Jul 03 12:54:38 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:39 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6a55196c-572a-412f-b18c-df373d3a4b3b" returned: 0 in 1.009s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Lock "cinder-quobyte-6a55196c-572a-412f-b18c-df373d3a4b3b" released by "delete_volume" :: held 2.215s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:54:39 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-862749e3-bf20-4646-aa96-4eb84a014095" returned: 0 in 1.161s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "cinder-quobyte-862749e3-bf20-4646-aa96-4eb84a014095" released by "delete_volume" :: held 2.195s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Created reservations ['98e33a6d-536a-4aa4-90d6-45c1983b318c', 'e98b47c7-cfa7-41f9-8d23-45c3ca13cf49', '4803b414-9369-4857-9eeb-bac93c9681da', '7696b985-50a4-4ab6-a8d0-d1c98542f6bd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Created reservations ['3a0c51a5-53e3-4082-b7aa-6af168e4e842', 'e6461fa1-e57c-4b82-a599-9314371940a5', '828e8baf-c5cb-416c-8236-e5ac56296919', '7bf4b8dc-6df9-4ba0-9859-143c4f6dea27'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:39 devstack sudo[94370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:54:39 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:40 devstack sudo[94372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:54:40 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:40 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.024s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:40 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:54:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Deleted volume successfully.
Jul 03 12:54:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c2c2c313-a5e8-4a97-b021-d82d8ef764ae tempest-ServerActionsTestOtherA-1688824323 None] Lock "cinder-6a55196c-572a-412f-b18c-df373d3a4b3b-delete_volume" released by "delete_volume" :: held 3.766s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:54:41 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.280s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:54:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Deleted volume successfully.
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-53950513-55a2-48ce-a7ad-4cf198bd6867 tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "cinder-862749e3-bf20-4646-aa96-4eb84a014095-delete_volume" released by "delete_volume" :: held 4.007s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Flow 'volume_create_manager' (9db6e9a3-0f36-4baf-aa0d-987119b00b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1bfa89-1957-457a-8da4-d2ad0d776739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1bfa89-1957-457a-8da4-d2ad0d776739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-990574958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52dab13-7728-4776-b08a-52af6b3b8b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000b5e505f554153a2e1f1ca014c4329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:42Z,use_quota=True,user_id='ca078e90e9ee48328ec5f4ac7165146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8a57fe-e26a-40c1-b11d-22fb327ebc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8a57fe-e26a-40c1-b11d-22fb327ebc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369bcd6a-7b1c-4fd1-89dc-7c343f94591d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369bcd6a-7b1c-4fd1-89dc-7c343f94591d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd52dab13-7728-4776-b08a-52af6b3b8b00', 'volume_name': 'volume-d52dab13-7728-4776-b08a-52af6b3b8b00', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db90e75-985f-44a4-9dbe-d68148a4cf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db90e75-985f-44a4-9dbe-d68148a4cf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcc9f8c-7627-40cf-9271-03521a851eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:41 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Volume d52dab13-7728-4776-b08a-52af6b3b8b00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d52dab13-7728-4776-b08a-52af6b3b8b00', 'volume_size': 1}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-990574958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52dab13-7728-4776-b08a-52af6b3b8b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000b5e505f554153a2e1f1ca014c4329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:42Z,use_quota=True,user_id='ca078e90e9ee48328ec5f4ac7165146a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Creating volume d52dab13-7728-4776-b08a-52af6b3b8b00 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:54:41 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:54:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:42 devstack sudo[94377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00 1073741824
Jul 03 12:54:42 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:43 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00 1073741824" returned: 0 in 1.578s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:43 devstack sudo[94425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00
Jul 03 12:54:43 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:43 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:54:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Flow 'volume_create_manager' (9a568a63-d6f0-4673-9af4-4b53095b582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193939d8-733b-40ff-aa39-625e89c011e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193939d8-733b-40ff-aa39-625e89c011e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-349170202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273ab365-6d3b-42b6-9dbc-d2526daa44f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77b57b5383d4aa485a5db40729909c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:44Z,use_quota=True,user_id='4b6b2c4e671e4148a127aec7e673f632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8612b773-d7b4-40c3-9a57-46560cd5bf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8612b773-d7b4-40c3-9a57-46560cd5bf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42ee44d-ca08-43a5-9204-d052612df0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42ee44d-ca08-43a5-9204-d052612df0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '273ab365-6d3b-42b6-9dbc-d2526daa44f0', 'volume_name': 'volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dd6bb0-07de-42b1-a27d-ad9fa4e39fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dd6bb0-07de-42b1-a27d-ad9fa4e39fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b55fdb-f68e-4172-a600-79f969393b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Volume 273ab365-6d3b-42b6-9dbc-d2526daa44f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0', 'volume_size': 1}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:44 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00" returned: 0 in 0.963s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] <== create_volume: return (2620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.623s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-349170202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273ab365-6d3b-42b6-9dbc-d2526daa44f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77b57b5383d4aa485a5db40729909c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:44Z,use_quota=True,user_id='4b6b2c4e671e4148a127aec7e673f632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Creating volume 273ab365-6d3b-42b6-9dbc-d2526daa44f0 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:54:44 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcc9f8c-7627-40cf-9271-03521a851eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d52dab13-7728-4776-b08a-52af6b3b8b00', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:44 devstack sudo[94429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0 1073741824
Jul 03 12:54:44 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7325d59-2818-442d-bac2-83d0c028dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Volume volume-d52dab13-7728-4776-b08a-52af6b3b8b00 (d52dab13-7728-4776-b08a-52af6b3b8b00): created successfully
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7325d59-2818-442d-bac2-83d0c028dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Flow 'volume_create_manager' (9db6e9a3-0f36-4baf-aa0d-987119b00b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1e143f21-7037-494c-b2b2-4b03c4291e5f tempest-VolumeQuotasAdminTestJSON-1618402642 None] Created volume successfully.
Jul 03 12:54:45 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0 1073741824" returned: 0 in 1.243s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:45 devstack sudo[94436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0
Jul 03 12:54:45 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9596dfb3-306b-4e9c-8aed-24e9470a17b6 tempest-VolumeQuotasAdminTestJSON-65886518 None] Transfer volume completed successfully.
Jul 03 12:54:46 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0" returned: 0 in 0.791s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:54:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b55fdb-f68e-4172-a600-79f969393b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc8491d-1375-42e2-857c-4715f6002ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Volume volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0 (273ab365-6d3b-42b6-9dbc-d2526daa44f0): created successfully
Jul 03 12:54:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc8491d-1375-42e2-857c-4715f6002ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Flow 'volume_create_manager' (9a568a63-d6f0-4673-9af4-4b53095b582a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0bb34f31-0944-45be-a525-da2119f800e8 tempest-AttachVolumeNegativeTest-1679123321 None] Created volume successfully.
Jul 03 12:54:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Acquiring lock "cinder-d52dab13-7728-4776-b08a-52af6b3b8b00-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:54:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Lock "cinder-d52dab13-7728-4776-b08a-52af6b3b8b00-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:54:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Acquiring lock "cinder-quobyte-d52dab13-7728-4776-b08a-52af6b3b8b00" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:54:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Lock "cinder-quobyte-d52dab13-7728-4776-b08a-52af6b3b8b00" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:54:47 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd2134d-157e-42d4-9a7a-1f3106967bb8]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:54:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:47 devstack sudo[94444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00
Jul 03 12:54:47 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:48 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00" returned: 0 in 1.268s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:48 devstack sudo[94485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00
Jul 03 12:54:48 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:49 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d52dab13-7728-4776-b08a-52af6b3b8b00" returned: 0 in 0.802s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Lock "cinder-quobyte-d52dab13-7728-4776-b08a-52af6b3b8b00" released by "delete_volume" :: held 2.150s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:54:49 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Created reservations ['83f8e22c-44ed-420e-bb5e-c4dc3810fb01', '96cc184c-3371-4114-b3c4-83f36cf194f9', 'ec9081c7-f499-4e6d-87ac-8ca7c4532737', 'e38718ba-6c2e-4769-b8aa-6ad14c209e73'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:54:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:49 devstack sudo[94489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:54:49 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:50 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.810s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:50 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:54:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Deleted volume successfully.
Jul 03 12:54:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30eb3d7e-3f92-4c75-b642-7a28d51bdae9 tempest-VolumeQuotasAdminTestJSON-1830950316 None] Lock "cinder-d52dab13-7728-4776-b08a-52af6b3b8b00-delete_volume" released by "delete_volume" :: held 3.389s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:54:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-38942c95-ae02-4e1c-81dc-46e4c8a5eb3d req-460b4fc7-641b-4c23-b756-2ba7da43d07a tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-38942c95-ae02-4e1c-81dc-46e4c8a5eb3d req-460b4fc7-641b-4c23-b756-2ba7da43d07a tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:51 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[490ad5dd-3f08-4ebf-b19f-f31608f59193]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:54:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-38942c95-ae02-4e1c-81dc-46e4c8a5eb3d req-460b4fc7-641b-4c23-b756-2ba7da43d07a tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:51 devstack sudo[94501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0
Jul 03 12:54:51 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:52 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-38942c95-ae02-4e1c-81dc-46e4c8a5eb3d req-460b4fc7-641b-4c23-b756-2ba7da43d07a tempest-AttachVolumeNegativeTest-1679123321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0" returned: 0 in 1.261s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-38942c95-ae02-4e1c-81dc-46e4c8a5eb3d req-460b4fc7-641b-4c23-b756-2ba7da43d07a tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.300s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-38942c95-ae02-4e1c-81dc-46e4c8a5eb3d req-460b4fc7-641b-4c23-b756-2ba7da43d07a tempest-AttachVolumeNegativeTest-1679123321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9985b46-a8b7-4eac-ab2a-0ce4acc4edec', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:54:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-38942c95-ae02-4e1c-81dc-46e4c8a5eb3d req-460b4fc7-641b-4c23-b756-2ba7da43d07a tempest-AttachVolumeNegativeTest-1679123321 None] attachment_update completed successfully.
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Flow 'volume_create_manager' (bd0b280a-3f2c-4dd9-8b08-1929d33876bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7b48b9-704d-4351-a9ec-22edfd0aa29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7b48b9-704d-4351-a9ec-22edfd0aa29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-399213408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b33d418-7e66-4928-9de1-0eed8875ad24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e3da1286fd4b21b7850520a6899a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:55Z,use_quota=True,user_id='b9a3368e8cb945ef9bcfcfba52bd9cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f402bb6-a789-42ac-b93b-78cef4f3cef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f402bb6-a789-42ac-b93b-78cef4f3cef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c853828-1467-4eb9-b2c3-c8ceb635c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c853828-1467-4eb9-b2c3-c8ceb635c66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b33d418-7e66-4928-9de1-0eed8875ad24', 'volume_name': 'volume-3b33d418-7e66-4928-9de1-0eed8875ad24', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cf3ab1-6dad-4c25-b101-0d749b05ef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cf3ab1-6dad-4c25-b101-0d749b05ef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db75894-2842-4506-ae15-256331168a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Volume 3b33d418-7e66-4928-9de1-0eed8875ad24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b33d418-7e66-4928-9de1-0eed8875ad24', 'volume_size': 1}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-399213408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b33d418-7e66-4928-9de1-0eed8875ad24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e3da1286fd4b21b7850520a6899a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:54:55Z,use_quota=True,user_id='b9a3368e8cb945ef9bcfcfba52bd9cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Creating volume 3b33d418-7e66-4928-9de1-0eed8875ad24 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:54:54 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:54:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:54 devstack sudo[94890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24 1073741824
Jul 03 12:54:54 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:56 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24 1073741824" returned: 0 in 1.457s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:56 devstack sudo[94897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24
Jul 03 12:54:56 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:57 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24" returned: 0 in 1.045s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] <== create_volume: return (2557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:54:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.565s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:54:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db75894-2842-4506-ae15-256331168a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b33d418-7e66-4928-9de1-0eed8875ad24', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ab86a1-d31d-4621-a675-678c4f45a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:54:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Volume volume-3b33d418-7e66-4928-9de1-0eed8875ad24 (3b33d418-7e66-4928-9de1-0eed8875ad24): created successfully
Jul 03 12:54:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ab86a1-d31d-4621-a675-678c4f45a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:54:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Flow 'volume_create_manager' (bd0b280a-3f2c-4dd9-8b08-1929d33876bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:54:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5b4deeeb-da84-47aa-aa89-af62c0e02329 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Created volume successfully.
Jul 03 12:54:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Acquiring lock "cinder-3b33d418-7e66-4928-9de1-0eed8875ad24-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:54:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Lock "cinder-3b33d418-7e66-4928-9de1-0eed8875ad24-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:54:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Acquiring lock "cinder-quobyte-3b33d418-7e66-4928-9de1-0eed8875ad24" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:54:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Lock "cinder-quobyte-3b33d418-7e66-4928-9de1-0eed8875ad24" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:54:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53febcc-fa62-435a-9e15-2778a58f044e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:54:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:59 devstack sudo[94903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24
Jul 03 12:54:59 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:00 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24" returned: 0 in 1.297s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:00 devstack sudo[94909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24
Jul 03 12:55:00 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:01 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3b33d418-7e66-4928-9de1-0eed8875ad24" returned: 0 in 1.011s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Lock "cinder-quobyte-3b33d418-7e66-4928-9de1-0eed8875ad24" released by "delete_volume" :: held 2.403s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:55:01 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Created reservations ['33dc59dd-51f6-47a4-b01e-51a9dfe7ec08', '6e696e62-d8d9-4fd2-be5b-7fa3a93ed8db', 'd0c611c3-68be-4cd7-9fb3-9e300b25d10e', '82c7e7a3-870f-4043-b215-78bafb185abd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:02 devstack sudo[94917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:55:02 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Flow 'volume_create_manager' (04869339-65c1-4064-ae4e-c9b75ce9afca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26703ae-5568-4775-9d83-cfd2ec5cd326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26703ae-5568-4775-9d83-cfd2ec5cd326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-614504237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0eac25-6157-4355-a116-4f6c771ad6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf8689ff56a43c1a3076dfb76e61f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:02Z,use_quota=True,user_id='c4ea2e17e4d347b89db90de632abc2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c484f71-7ad2-4569-b83c-2e4d031ff4e2),volume_type_id=8c484f71-7ad2-4569-b83c-2e4d031ff4e2)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230abb39-6764-4a92-8dbb-153bd1693c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230abb39-6764-4a92-8dbb-153bd1693c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffece28-c22c-41c4-9265-e42efd075205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffece28-c22c-41c4-9265-e42efd075205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0eac25-6157-4355-a116-4f6c771ad6cc', 'volume_name': 'volume-eb0eac25-6157-4355-a116-4f6c771ad6cc', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ab4f04-3e1f-481d-a90f-866bcdb69dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ab4f04-3e1f-481d-a90f-866bcdb69dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75fd32e-999c-4750-b580-0464c932976f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Volume eb0eac25-6157-4355-a116-4f6c771ad6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0eac25-6157-4355-a116-4f6c771ad6cc', 'volume_size': 1}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-614504237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0eac25-6157-4355-a116-4f6c771ad6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf8689ff56a43c1a3076dfb76e61f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:02Z,use_quota=True,user_id='c4ea2e17e4d347b89db90de632abc2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c484f71-7ad2-4569-b83c-2e4d031ff4e2),volume_type_id=8c484f71-7ad2-4569-b83c-2e4d031ff4e2)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Creating volume eb0eac25-6157-4355-a116-4f6c771ad6cc {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:55:02 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:55:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:02 devstack sudo[94919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc 1073741824
Jul 03 12:55:02 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:03 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.140s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:03 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:55:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Deleted volume successfully.
Jul 03 12:55:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1be0540-7646-4a58-9681-1d556f689bd6 tempest-VolumeQuotasNegativeTestJSON-1235590344 None] Lock "cinder-3b33d418-7e66-4928-9de1-0eed8875ad24-delete_volume" released by "delete_volume" :: held 3.950s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:55:03 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc 1073741824" returned: 0 in 1.585s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:04 devstack sudo[94935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc
Jul 03 12:55:04 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:04 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc" returned: 0 in 0.832s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] <== create_volume: return (2496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:55:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.502s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75fd32e-999c-4750-b580-0464c932976f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0eac25-6157-4355-a116-4f6c771ad6cc', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7ad814-c8a4-4c06-99a7-040af82b4962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Volume volume-eb0eac25-6157-4355-a116-4f6c771ad6cc (eb0eac25-6157-4355-a116-4f6c771ad6cc): created successfully
Jul 03 12:55:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7ad814-c8a4-4c06-99a7-040af82b4962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Flow 'volume_create_manager' (04869339-65c1-4064-ae4e-c9b75ce9afca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:55:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d8833f65-eb0a-4819-94e5-2f9f3cd944ef tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Created volume successfully.
Jul 03 12:55:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:55:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:55:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:55:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:05 devstack sudo[94939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:55:05 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:06 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.013s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:55:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-21af044d-c8a4-40db-aa94-7ba12bfbb48e tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-21af044d-c8a4-40db-aa94-7ba12bfbb48e tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-21af044d-c8a4-40db-aa94-7ba12bfbb48e tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:55:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-21af044d-c8a4-40db-aa94-7ba12bfbb48e tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:55:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-21af044d-c8a4-40db-aa94-7ba12bfbb48e tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-21af044d-c8a4-40db-aa94-7ba12bfbb48e tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:06 devstack sudo[94942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:55:06 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:07 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-21af044d-c8a4-40db-aa94-7ba12bfbb48e tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.856s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:07 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-21af044d-c8a4-40db-aa94-7ba12bfbb48e tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:55:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-21af044d-c8a4-40db-aa94-7ba12bfbb48e tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Retype volume completed successfully.
Jul 03 12:55:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Acquiring lock "cinder-eb0eac25-6157-4355-a116-4f6c771ad6cc-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:55:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "cinder-eb0eac25-6157-4355-a116-4f6c771ad6cc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:55:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Acquiring lock "cinder-quobyte-eb0eac25-6157-4355-a116-4f6c771ad6cc" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:55:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "cinder-quobyte-eb0eac25-6157-4355-a116-4f6c771ad6cc" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:55:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dad23d-1647-4e7f-91d0-e8b796fa0bf3]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:08 devstack sudo[94945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc
Jul 03 12:55:08 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:09 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc" returned: 0 in 1.325s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:09 devstack sudo[94952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc
Jul 03 12:55:09 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:10 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eb0eac25-6157-4355-a116-4f6c771ad6cc" returned: 0 in 1.205s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "cinder-quobyte-eb0eac25-6157-4355-a116-4f6c771ad6cc" released by "delete_volume" :: held 2.616s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:55:10 devstack cinder-volume[86763]: WARNING cinder.quota [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:55:10 devstack cinder-volume[86763]: WARNING cinder.quota [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:55:10 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Created reservations ['23de8489-9b49-4b6c-8c37-075c4130adf3', '510b4462-551a-4672-a718-00c47a2c1be1', 'f29c43c2-b6fe-4de3-a558-41faef5da86a', '035ff87a-2407-4679-8d71-df76e3112c53'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:55:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:55:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:55:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:10 devstack sudo[94968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:55:10 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:12 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.449s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:55:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Deleted volume successfully.
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c6598b87-3458-4525-8ff7-0b46280a1dc1 tempest-VolumeRetypeWithoutMigrationTest-1346457182 None] Lock "cinder-eb0eac25-6157-4355-a116-4f6c771ad6cc-delete_volume" released by "delete_volume" :: held 4.520s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Flow 'volume_create_manager' (b884cf89-c5ca-4979-a28c-29d12eadaa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45886e64-7b01-4470-b454-9b1a572fe049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45886e64-7b01-4470-b454-9b1a572fe049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1790056057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be547f90-bbbb-486f-afc3-3cc99d2af8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7450e275124548817eb097f26446e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:13Z,use_quota=True,user_id='6b745dd0f26e4d5b9db476bc1a310c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd56c3d-fc0e-4813-95de-843adea44f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd56c3d-fc0e-4813-95de-843adea44f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ba69ee-9e64-4b36-ab55-7423c3b44ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ba69ee-9e64-4b36-ab55-7423c3b44ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be547f90-bbbb-486f-afc3-3cc99d2af8a8', 'volume_name': 'volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf29ef0-e9c9-48b5-b92c-c733b09e8acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf29ef0-e9c9-48b5-b92c-c733b09e8acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45df16e-781a-44e7-95e8-f75c84e33d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:12 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Volume be547f90-bbbb-486f-afc3-3cc99d2af8a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8', 'volume_size': 1}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1790056057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be547f90-bbbb-486f-afc3-3cc99d2af8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7450e275124548817eb097f26446e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:13Z,use_quota=True,user_id='6b745dd0f26e4d5b9db476bc1a310c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Creating volume be547f90-bbbb-486f-afc3-3cc99d2af8a8 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:55:12 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:55:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:12 devstack sudo[95003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 1073741824
Jul 03 12:55:12 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:14 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 1073741824" returned: 0 in 1.156s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:14 devstack sudo[95009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8
Jul 03 12:55:14 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:14 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8" returned: 0 in 0.852s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:55:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45df16e-781a-44e7-95e8-f75c84e33d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde9a382-3b26-4838-8dec-4d16817a1de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:15 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Volume volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 (be547f90-bbbb-486f-afc3-3cc99d2af8a8): created successfully
Jul 03 12:55:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde9a382-3b26-4838-8dec-4d16817a1de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Flow 'volume_create_manager' (b884cf89-c5ca-4979-a28c-29d12eadaa95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:55:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c539c688-ad76-4c44-b3ea-10abbb424377 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Created volume successfully.
Jul 03 12:55:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Creating offline snapshot 3c43b00b-2574-49b3-8e56-73ff049d9a6c of volume be547f90-bbbb-486f-afc3-3cc99d2af8a8 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:55:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f787cce-50e7-4140-ba33-1a7d8f5e9a17]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:16 devstack sudo[95012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8
Jul 03 12:55:16 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:17 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8" returned: 0 in 1.385s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:17 devstack sudo[95437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c 1G
Jul 03 12:55:17 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:19 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c 1G" returned: 0 in 1.203s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:19 devstack sudo[95450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c
Jul 03 12:55:19 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:20 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c" returned: 0 in 1.110s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:20 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c is being set with open permissions: ugo+rw
Jul 03 12:55:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:20 devstack sudo[95490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c
Jul 03 12:55:20 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:21 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c" returned: 0 in 0.823s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:21 devstack sudo[95494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.info
Jul 03 12:55:21 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:21 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.info" returned: 0 in 0.846s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:21 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.info is being set with open permissions: ugo+rw
Jul 03 12:55:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:22 devstack sudo[95497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.info
Jul 03 12:55:22 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:23 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.info" returned: 0 in 1.079s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.609s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0ee36ddc-5e2c-47d6-93d6-71fe77df508c tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Create snapshot completed successfully
Jul 03 12:55:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Acquiring lock "cinder-3c43b00b-2574-49b3-8e56-73ff049d9a6c-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:55:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "cinder-3c43b00b-2574-49b3-8e56-73ff049d9a6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:55:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Acquiring lock "cinder-quobyte-be547f90-bbbb-486f-afc3-3cc99d2af8a8" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:55:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "cinder-quobyte-be547f90-bbbb-486f-afc3-3cc99d2af8a8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:55:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Acquiring lock "cinder-quobyte-3c43b00b-2574-49b3-8e56-73ff049d9a6c" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:55:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "cinder-quobyte-3c43b00b-2574-49b3-8e56-73ff049d9a6c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:55:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Deleting offline snapshot 3c43b00b-2574-49b3-8e56-73ff049d9a6c of volume be547f90-bbbb-486f-afc3-3cc99d2af8a8 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:55:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] snapshot_file for this snap is: volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:55:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e5f45a-2fc5-4576-a86e-5465c7b1b9cf]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:25 devstack sudo[95504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c
Jul 03 12:55:25 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:27 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c" returned: 0 in 1.962s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:55:27 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a689086-e735-4098-b92e-afc3d671fe21]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:27 devstack sudo[95521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8
Jul 03 12:55:27 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:28 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8" returned: 0 in 1.305s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:28 devstack sudo[95533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c
Jul 03 12:55:28 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:29 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c" returned: 0 in 1.208s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:29 devstack sudo[95541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c
Jul 03 12:55:29 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:30 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8.3c43b00b-2574-49b3-8e56-73ff049d9a6c" returned: 0 in 1.134s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:30 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=70,cinder:UPDATE=89,cinder:INSERT=26,cinder:DELETE=5 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:55:30 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=74,cinder:UPDATE=84,cinder:INSERT=10,cinder:DELETE=7 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:55:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "cinder-quobyte-3c43b00b-2574-49b3-8e56-73ff049d9a6c" released by "_delete_snapshot" :: held 5.886s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:55:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "cinder-quobyte-be547f90-bbbb-486f-afc3-3cc99d2af8a8" released by "delete_snapshot" :: held 5.941s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:55:31 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Created reservations ['4fd9d24e-f4fd-48a7-a8e6-46f3195c3b31', 'ab174a5b-cddf-45ca-8ce0-fa06b2d4b1b1', 'f27c35b3-cd87-4ada-9bd5-94f7cb915f71', '855048fa-c42d-4da4-a5c5-9d0b751f58ab'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:55:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Delete snapshot completed successfully.
Jul 03 12:55:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9c79eaf2-eccd-4ca7-a14e-11173996c8a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "cinder-3c43b00b-2574-49b3-8e56-73ff049d9a6c-delete_snapshot" released by "delete_snapshot" :: held 6.215s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:55:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Acquiring lock "cinder-be547f90-bbbb-486f-afc3-3cc99d2af8a8-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:55:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "cinder-be547f90-bbbb-486f-afc3-3cc99d2af8a8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:55:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Acquiring lock "cinder-quobyte-be547f90-bbbb-486f-afc3-3cc99d2af8a8" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:55:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "cinder-quobyte-be547f90-bbbb-486f-afc3-3cc99d2af8a8" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:55:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[409b1ce6-8c47-4d1e-9b59-8a9a1f5d7721]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:32 devstack sudo[95545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8
Jul 03 12:55:32 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:32 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8" returned: 0 in 1.045s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:32 devstack sudo[95550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8
Jul 03 12:55:32 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:33 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be547f90-bbbb-486f-afc3-3cc99d2af8a8" returned: 0 in 0.900s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "cinder-quobyte-be547f90-bbbb-486f-afc3-3cc99d2af8a8" released by "delete_volume" :: held 2.052s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:55:33 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Created reservations ['3b3c37a3-4321-44ab-b825-f41db5ff851e', '74f02ada-68bc-4cc8-965e-d85eb562bd91', '0c633ee3-bb4b-4fcb-9a92-a6df84cc2559', '6a049efe-6698-4dd6-88cc-62f7d9d71e27'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:34 devstack sudo[95557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:55:34 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Flow 'volume_create_manager' (182c805e-ae55-4388-bf9c-d0e7d35dd6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462b9df8-0f6e-4672-b184-c63e8b67cc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462b9df8-0f6e-4672-b184-c63e8b67cc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1615615572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e82e928-afd4-483b-8371-8576aa10784f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1b7aa75b5c47abae476f7c5e63cefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:34Z,use_quota=True,user_id='14ee3124a2ec4f48bb6d2d8c833228af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6d2085-5cac-474e-ad75-f5b5b6efa7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6d2085-5cac-474e-ad75-f5b5b6efa7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81302963-704f-41a5-b75c-429d05160db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 12:55:34 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.759s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:55:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Deleted volume successfully.
Jul 03 12:55:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-508f5834-39a2-4b66-82cc-106af9f37d75 tempest-VolumeSnapshotQuotasNegativeTestJSON-736594088 None] Lock "cinder-be547f90-bbbb-486f-afc3-3cc99d2af8a8-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:55:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81302963-704f-41a5-b75c-429d05160db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e82e928-afd4-483b-8371-8576aa10784f', 'volume_name': 'volume-8e82e928-afd4-483b-8371-8576aa10784f', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b64cee10>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21797aa-c3a4-441b-b87d-bbf950ddfc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21797aa-c3a4-441b-b87d-bbf950ddfc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494f785c-263f-4a22-8e21-8650a30a8758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Volume 8e82e928-afd4-483b-8371-8576aa10784f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e82e928-afd4-483b-8371-8576aa10784f', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b64cee10>}
Jul 03 12:55:35 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Trying to clone 8e82e928-afd4-483b-8371-8576aa10784f from image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jul 03 12:55:36 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jul 03 12:55:36 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 12:55:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a912ac9-19cd-447e-9ecf-a333b3de5d60]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:36 devstack sudo[95654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD
Jul 03 12:55:36 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:37 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD" returned: 0 in 1.171s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:37 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Temporary image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 is fetched for user 14ee3124a2ec4f48bb6d2d8c833228af. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jul 03 12:55:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[462e2333-ae4a-405b-8e65-bfc67b4404ac]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:38 devstack sudo[95674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD
Jul 03 12:55:38 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:39 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD" returned: 0 in 1.481s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1615615572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e82e928-afd4-483b-8371-8576aa10784f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1b7aa75b5c47abae476f7c5e63cefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:34Z,use_quota=True,user_id='14ee3124a2ec4f48bb6d2d8c833228af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Creating volume 8e82e928-afd4-483b-8371-8576aa10784f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:55:39 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:55:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:39 devstack sudo[95681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f 1073741824
Jul 03 12:55:39 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:40 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f 1073741824" returned: 0 in 1.518s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:40 devstack sudo[95712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f
Jul 03 12:55:40 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:41 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f" returned: 0 in 1.057s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] <== create_volume: return (2653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:55:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.660s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:41 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Attempting download of 8af9b126-5566-44ac-8948-4fb0a1be3fd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}])) to volume 8e82e928-afd4-483b-8371-8576aa10784f. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jul 03 12:55:42 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4e3341-20b7-4613-bb73-d69adbe87189]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_s3gs2zan {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:42 devstack sudo[95718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_s3gs2zan
Jul 03 12:55:42 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:43 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_s3gs2zan" returned: 0 in 1.265s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_s3gs2zan {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:43 devstack sudo[95737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_s3gs2zan
Jul 03 12:55:43 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:44 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_s3gs2zan" returned: 1 in 1.053s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_s3gs2zan' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 12:55:44 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e911e57-17dd-45bf-94e0-c15a0b09f550]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:44 devstack sudo[95741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD
Jul 03 12:55:44 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:45 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD" returned: 0 in 1.072s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:45 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] 8af9b126-5566-44ac-8948-4fb0a1be3fd3 was qcow2, converting to raw {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jul 03 12:55:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:45 devstack sudo[95747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f
Jul 03 12:55:45 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Flow 'volume_create_manager' (b27b69cc-e3cd-4a9d-85c8-ed8cf918e5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e03094-e1e4-448a-87aa-86936ee43890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e03094-e1e4-448a-87aa-86936ee43890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-654057078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517139d3-d744-471e-a428-595c5543f8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196e688d70e14cbd8a384b68fb558c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:48Z,use_quota=True,user_id='0ee1dc7b254f421596f4e0eee7485d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47134d96-5874-4ba1-8381-2e43abdb8c77),volume_type_id=47134d96-5874-4ba1-8381-2e43abdb8c77)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ccbe01-85e4-4aac-9c0b-99b49cc1de94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ccbe01-85e4-4aac-9c0b-99b49cc1de94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a25c66-bf25-4032-9323-0400515206e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a25c66-bf25-4032-9323-0400515206e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '517139d3-d744-471e-a428-595c5543f8c9', 'volume_name': 'volume-517139d3-d744-471e-a428-595c5543f8c9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e7f6da-9959-4ace-b4e1-a3d7324321a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e7f6da-9959-4ace-b4e1-a3d7324321a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72792eb8-43a7-4266-ad93-ea7fcaa48dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:47 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Volume 517139d3-d744-471e-a428-595c5543f8c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-517139d3-d744-471e-a428-595c5543f8c9', 'volume_size': 1}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-654057078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517139d3-d744-471e-a428-595c5543f8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196e688d70e14cbd8a384b68fb558c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:55:48Z,use_quota=True,user_id='0ee1dc7b254f421596f4e0eee7485d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47134d96-5874-4ba1-8381-2e43abdb8c77),volume_type_id=47134d96-5874-4ba1-8381-2e43abdb8c77)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Creating volume 517139d3-d744-471e-a428-595c5543f8c9 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:55:47 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:55:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:47 devstack sudo[95761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9 1073741824
Jul 03 12:55:47 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:49 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f" returned: 0 in 4.502s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:49 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_10uwdy_vdevstack@QuobyteHD, size 112.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 12:55:49 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Converted 112.00 MB image at 24.87 MB/s
Jul 03 12:55:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:49 devstack sudo[95806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f 1G
Jul 03 12:55:49 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:50 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9 1073741824" returned: 0 in 2.735s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:50 devstack sudo[95818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9
Jul 03 12:55:50 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:51 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f 1G" returned: 0 in 1.525s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:51 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d61f09-05d5-4798-883a-af9bbe8130ed]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:51 devstack sudo[95853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f
Jul 03 12:55:51 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:52 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9" returned: 0 in 1.882s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] <== create_volume: return (4735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:55:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.745s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72792eb8-43a7-4266-ad93-ea7fcaa48dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-517139d3-d744-471e-a428-595c5543f8c9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99111070-2915-4b2c-b743-b814254e2ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:52 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Volume volume-517139d3-d744-471e-a428-595c5543f8c9 (517139d3-d744-471e-a428-595c5543f8c9): created successfully
Jul 03 12:55:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99111070-2915-4b2c-b743-b814254e2ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Flow 'volume_create_manager' (b27b69cc-e3cd-4a9d-85c8-ed8cf918e5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:55:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-79910daf-cc03-4c02-86b5-8b9b6a255f0b tempest-VolumeTypesAccessTest-627623585 None] Created volume successfully.
Jul 03 12:55:53 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f" returned: 0 in 1.635s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:53 devstack sudo[95889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f
Jul 03 12:55:53 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Acquiring lock "cinder-517139d3-d744-471e-a428-595c5543f8c9-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:55:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Lock "cinder-517139d3-d744-471e-a428-595c5543f8c9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:55:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Acquiring lock "cinder-quobyte-517139d3-d744-471e-a428-595c5543f8c9" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:55:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Lock "cinder-quobyte-517139d3-d744-471e-a428-595c5543f8c9" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:55:53 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e6118f-1bbb-44ae-94ea-c938b7c8b127]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:53 devstack sudo[95892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9
Jul 03 12:55:53 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:54 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f" returned: 1 in 1.226s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Downloaded image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}])) to volume 8e82e928-afd4-483b-8371-8576aa10784f successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Temporary image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 for user 14ee3124a2ec4f48bb6d2d8c833228af is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Marking volume 8e82e928-afd4-483b-8371-8576aa10784f as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Copying metadata from image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 to 8e82e928-afd4-483b-8371-8576aa10784f. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Creating volume glance metadata for volume 8e82e928-afd4-483b-8371-8576aa10784f backed by image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494f785c-263f-4a22-8e21-8650a30a8758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e82e928-afd4-483b-8371-8576aa10784f', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b64cee10>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77de09d9-8227-4eed-ab2f-4bb46769dfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:55:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Volume volume-8e82e928-afd4-483b-8371-8576aa10784f (8e82e928-afd4-483b-8371-8576aa10784f): created successfully
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77de09d9-8227-4eed-ab2f-4bb46769dfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Flow 'volume_create_manager' (182c805e-ae55-4388-bf9c-d0e7d35dd6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:55:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-febd586f-751b-478d-8a64-652a59d4d2e1 tempest-VolumesExtendTest-1705985643 None] Created volume successfully.
Jul 03 12:55:54 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9" returned: 0 in 1.218s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:54 devstack sudo[95903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9
Jul 03 12:55:54 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00660785-99c8-4905-a32e-0d0c4e8e898c tempest-VolumesExtendTest-1705985643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00660785-99c8-4905-a32e-0d0c4e8e898c tempest-VolumesExtendTest-1705985643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b049259-1ff9-4392-adec-cd0f8d727c0e]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00660785-99c8-4905-a32e-0d0c4e8e898c tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:55 devstack sudo[95905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f
Jul 03 12:55:55 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:55 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-517139d3-d744-471e-a428-595c5543f8c9" returned: 0 in 0.853s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Lock "cinder-quobyte-517139d3-d744-471e-a428-595c5543f8c9" released by "delete_volume" :: held 2.147s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:55:55 devstack cinder-volume[86763]: WARNING cinder.quota [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1413439541 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1413439541, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:55:55 devstack cinder-volume[86763]: WARNING cinder.quota [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1413439541 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1413439541, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Created reservations ['2081e3c3-b8c2-43a4-a9d5-d973fc865790', 'b2c07691-dcc0-4833-be99-2b7f200c4a3f', 'a64fc67c-dd00-48b4-a57e-42e45ddfdc85', '566d636f-48de-45d9-bbb5-0792b3fb1dd6'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:55 devstack sudo[95908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:55:55 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:56 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00660785-99c8-4905-a32e-0d0c4e8e898c tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f" returned: 0 in 1.250s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00660785-99c8-4905-a32e-0d0c4e8e898c tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:56 devstack sudo[95916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f
Jul 03 12:55:56 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:57 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.052s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:57 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:55:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Deleted volume successfully.
Jul 03 12:55:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cdbe85fe-639e-45ab-8acd-d5e28cd4b9fa tempest-VolumeTypesAccessTest-627623585 None] Lock "cinder-517139d3-d744-471e-a428-595c5543f8c9-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:55:57 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00660785-99c8-4905-a32e-0d0c4e8e898c tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f" returned: 1 in 1.114s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00660785-99c8-4905-a32e-0d0c4e8e898c tempest-VolumesExtendTest-1705985643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 12:55:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00660785-99c8-4905-a32e-0d0c4e8e898c tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f 2G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00660785-99c8-4905-a32e-0d0c4e8e898c tempest-VolumesExtendTest-1705985643 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f 2G" returned: 0 in 0.106s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00660785-99c8-4905-a32e-0d0c4e8e898c tempest-VolumesExtendTest-1705985643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.539s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:55:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-00660785-99c8-4905-a32e-0d0c4e8e898c tempest-VolumesExtendTest-1705985643 None] Extend volume completed successfully.
Jul 03 12:55:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Acquiring lock "cinder-8e82e928-afd4-483b-8371-8576aa10784f-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:55:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Lock "cinder-8e82e928-afd4-483b-8371-8576aa10784f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:55:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Acquiring lock "cinder-quobyte-8e82e928-afd4-483b-8371-8576aa10784f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:55:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Lock "cinder-quobyte-8e82e928-afd4-483b-8371-8576aa10784f" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:55:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b913c-3630-4b85-8868-23cd0890b979]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:55:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:59 devstack sudo[95965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f
Jul 03 12:55:59 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:01 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f" returned: 0 in 2.040s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:01 devstack sudo[95976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f
Jul 03 12:56:01 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:03 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f" returned: 1 in 1.768s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 12:56:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:03 devstack sudo[95988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f
Jul 03 12:56:03 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-f30315ed-5e1a-4235-946e-2c7b786f3e2c req-56109196-277d-45f5-b359-a0434325b6aa tempest-AttachVolumeNegativeTest-1679123321 None] Terminate volume connection completed successfully.
Jul 03 12:56:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-f30315ed-5e1a-4235-946e-2c7b786f3e2c req-56109196-277d-45f5-b359-a0434325b6aa tempest-AttachVolumeNegativeTest-1679123321 None] Deleting attachment b9985b46-a8b7-4eac-ab2a-0ce4acc4edec. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:56:04 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8e82e928-afd4-483b-8371-8576aa10784f" returned: 0 in 1.397s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Lock "cinder-quobyte-8e82e928-afd4-483b-8371-8576aa10784f" released by "delete_volume" :: held 5.369s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:04 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Created reservations ['3afce4d8-a15c-4e2d-b18c-bab2af406d85', '2ea0db4c-b4df-4290-aacd-a33f2bfa1e43', '0bb9a8a1-f054-4cd2-ad5d-380707613aba', '4744671d-68e9-4832-a70a-ed62d70ee76e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:56:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:05 devstack sudo[95996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:56:05 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:56:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:05 devstack sudo[95998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:56:05 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Flow 'volume_create_manager' (85195afb-af75-4912-a15e-0bcb552e8e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9beb59-00b1-4388-8d25-878af4d060fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9beb59-00b1-4388-8d25-878af4d060fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2111648446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000246f5-e262-4b74-adb3-a7870ee30525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1b7aa75b5c47abae476f7c5e63cefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:06Z,use_quota=True,user_id='14ee3124a2ec4f48bb6d2d8c833228af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa622b99-1732-431d-8406-869fd94b06d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa622b99-1732-431d-8406-869fd94b06d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204f2e10-21e7-47c8-85ad-cbbc88484aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204f2e10-21e7-47c8-85ad-cbbc88484aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '000246f5-e262-4b74-adb3-a7870ee30525', 'volume_name': 'volume-000246f5-e262-4b74-adb3-a7870ee30525', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9f8ec7-d98e-4b42-ad9b-606669ad95d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9f8ec7-d98e-4b42-ad9b-606669ad95d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99315f3-9581-4e73-919e-42c3cae97f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:06 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Volume 000246f5-e262-4b74-adb3-a7870ee30525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-000246f5-e262-4b74-adb3-a7870ee30525', 'volume_size': 1}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2111648446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000246f5-e262-4b74-adb3-a7870ee30525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1b7aa75b5c47abae476f7c5e63cefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:06Z,use_quota=True,user_id='14ee3124a2ec4f48bb6d2d8c833228af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Creating volume 000246f5-e262-4b74-adb3-a7870ee30525 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:56:06 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:56:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:06 devstack sudo[96033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525 1073741824
Jul 03 12:56:06 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:07 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 2.012s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:07 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:56:07 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 2.220s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:07 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:56:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Deleted volume successfully.
Jul 03 12:56:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f18c023a-aea6-46ee-88c8-e62abbc1c2c0 tempest-VolumesExtendTest-1705985643 None] Lock "cinder-8e82e928-afd4-483b-8371-8576aa10784f-delete_volume" released by "delete_volume" :: held 8.104s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:08 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525 1073741824" returned: 0 in 2.009s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:08 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525
Jul 03 12:56:08 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:09 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525" returned: 0 in 1.055s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] <== create_volume: return (3165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:56:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.175s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99315f3-9581-4e73-919e-42c3cae97f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000246f5-e262-4b74-adb3-a7870ee30525', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d163bd7-7b91-44c0-a8d7-617489d8e7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Volume volume-000246f5-e262-4b74-adb3-a7870ee30525 (000246f5-e262-4b74-adb3-a7870ee30525): created successfully
Jul 03 12:56:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d163bd7-7b91-44c0-a8d7-617489d8e7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Flow 'volume_create_manager' (85195afb-af75-4912-a15e-0bcb552e8e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:56:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d46d048a-6d39-4ae8-a979-dc4dce2c4379 tempest-VolumesExtendTest-1705985643 None] Created volume successfully.
Jul 03 12:56:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] Creating offline snapshot 08164bba-c276-4da6-baee-50dd5429a07a of volume 000246f5-e262-4b74-adb3-a7870ee30525 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:56:11 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa529ac-f601-4ecd-99ea-f96b229e9d55]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:56:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:11 devstack sudo[96087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525
Jul 03 12:56:11 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:12 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525" returned: 0 in 1.065s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:12 devstack sudo[96092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a 1G
Jul 03 12:56:12 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:13 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a 1G" returned: 0 in 1.203s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000246f5-e262-4b74-adb3-a7870ee30525 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:13 devstack sudo[96097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000246f5-e262-4b74-adb3-a7870ee30525 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a
Jul 03 12:56:13 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:14 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-000246f5-e262-4b74-adb3-a7870ee30525 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a" returned: 0 in 0.987s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:14 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a is being set with open permissions: ugo+rw
Jul 03 12:56:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:14 devstack sudo[96103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a
Jul 03 12:56:14 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Flow 'volume_create_manager' (187b580c-a0e9-4e31-b6b4-283733ebda64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff10aaee-f384-41f8-8522-8a77c2de8d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff10aaee-f384-41f8-8522-8a77c2de8d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1311448038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5109e79-a453-4ced-9e2f-cb890059be33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fc92177be8426ba95262f11d3172c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:15Z,use_quota=True,user_id='f793dfdd5b8a4b9199055c04746f5b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602ca48a-1c2e-4391-a922-946e0f286271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602ca48a-1c2e-4391-a922-946e0f286271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f50ea9-e28c-4606-8e69-6ec2a59ceae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f50ea9-e28c-4606-8e69-6ec2a59ceae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5109e79-a453-4ced-9e2f-cb890059be33', 'volume_name': 'volume-f5109e79-a453-4ced-9e2f-cb890059be33', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eca2768-d1ab-40c2-9f9c-a9e372de5765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eca2768-d1ab-40c2-9f9c-a9e372de5765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc8acfb-3333-44ee-bfff-07ab78602cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:15 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Volume f5109e79-a453-4ced-9e2f-cb890059be33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5109e79-a453-4ced-9e2f-cb890059be33', 'volume_size': 1}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:15 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a" returned: 0 in 1.077s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:15 devstack sudo[96106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.info
Jul 03 12:56:15 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:16 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.info" returned: 0 in 1.002s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:16 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.info is being set with open permissions: ugo+rw
Jul 03 12:56:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:16 devstack sudo[96109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.info
Jul 03 12:56:16 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:17 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.info" returned: 0 in 1.209s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.746s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.514s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1311448038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5109e79-a453-4ced-9e2f-cb890059be33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fc92177be8426ba95262f11d3172c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:15Z,use_quota=True,user_id='f793dfdd5b8a4b9199055c04746f5b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Creating volume f5109e79-a453-4ced-9e2f-cb890059be33 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:56:17 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:56:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:18 devstack sudo[96112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33 1073741824
Jul 03 12:56:18 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4d07eeeb-2f0b-4b7d-94cc-090e1d4e2043 tempest-VolumesExtendTest-1705985643 None] Create snapshot completed successfully
Jul 03 12:56:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8155b3b8-fefd-4103-b212-4a5359770bcb tempest-VolumesExtendTest-1705985643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:19 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33 1073741824" returned: 0 in 1.317s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:19 devstack sudo[96118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33
Jul 03 12:56:19 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:20 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33" returned: 0 in 0.873s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8155b3b8-fefd-4103-b212-4a5359770bcb tempest-VolumesExtendTest-1705985643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.514s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc8acfb-3333-44ee-bfff-07ab78602cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5109e79-a453-4ced-9e2f-cb890059be33', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e383ae71-d2c3-4ca0-99ff-b15f0f3a15a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c72f581-d75f-4631-b72b-d58a483fed4f]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8155b3b8-fefd-4103-b212-4a5359770bcb tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:20 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Volume volume-f5109e79-a453-4ced-9e2f-cb890059be33 (f5109e79-a453-4ced-9e2f-cb890059be33): created successfully
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e383ae71-d2c3-4ca0-99ff-b15f0f3a15a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Flow 'volume_create_manager' (187b580c-a0e9-4e31-b6b4-283733ebda64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:56:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ba14d270-b17d-42b7-b849-38d077f71f73 tempest-ServersNegativeTestJSON-1518126226 None] Created volume successfully.
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Flow 'volume_create_manager' (26d5df2b-15f3-4bd8-8d85-4a475fd7e876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:56:20 devstack sudo[96122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331a65c1-7754-43b0-a5ba-5b721a834b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:20 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331a65c1-7754-43b0-a5ba-5b721a834b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-977577038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a818a6d9-d855-4146-8322-b66a2c01d290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158697c80096472d9513e03915bc82e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:20Z,use_quota=True,user_id='61ac25db5b2c4fbf99c1473b0e59b5b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc58945-80cc-490b-a86c-d64122fe37b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc58945-80cc-490b-a86c-d64122fe37b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e5c508-61d8-4261-b0f9-b19554e84da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e5c508-61d8-4261-b0f9-b19554e84da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a818a6d9-d855-4146-8322-b66a2c01d290', 'volume_name': 'volume-a818a6d9-d855-4146-8322-b66a2c01d290', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ac7c62-0c84-47f8-a998-31046bdfba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ac7c62-0c84-47f8-a998-31046bdfba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ed2ebc-19f6-4f18-a9cb-4c03b3e35f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:20 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Volume a818a6d9-d855-4146-8322-b66a2c01d290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a818a6d9-d855-4146-8322-b66a2c01d290', 'volume_size': 1}
Jul 03 12:56:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:21 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8155b3b8-fefd-4103-b212-4a5359770bcb tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525" returned: 0 in 1.071s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8155b3b8-fefd-4103-b212-4a5359770bcb tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a 2G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8155b3b8-fefd-4103-b212-4a5359770bcb tempest-VolumesExtendTest-1705985643 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a 2G" returned: 0 in 0.172s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8155b3b8-fefd-4103-b212-4a5359770bcb tempest-VolumesExtendTest-1705985643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.308s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.028s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-977577038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a818a6d9-d855-4146-8322-b66a2c01d290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158697c80096472d9513e03915bc82e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:20Z,use_quota=True,user_id='61ac25db5b2c4fbf99c1473b0e59b5b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Creating volume a818a6d9-d855-4146-8322-b66a2c01d290 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:56:21 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:56:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:21 devstack sudo[96135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290 1073741824
Jul 03 12:56:21 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8155b3b8-fefd-4103-b212-4a5359770bcb tempest-VolumesExtendTest-1705985643 None] Extend volume completed successfully.
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Acquiring lock "cinder-08164bba-c276-4da6-baee-50dd5429a07a-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Lock "cinder-08164bba-c276-4da6-baee-50dd5429a07a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Acquiring lock "cinder-quobyte-000246f5-e262-4b74-adb3-a7870ee30525" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Lock "cinder-quobyte-000246f5-e262-4b74-adb3-a7870ee30525" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Acquiring lock "cinder-quobyte-08164bba-c276-4da6-baee-50dd5429a07a" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Lock "cinder-quobyte-08164bba-c276-4da6-baee-50dd5429a07a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Deleting offline snapshot 08164bba-c276-4da6-baee-50dd5429a07a of volume 000246f5-e262-4b74-adb3-a7870ee30525 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] snapshot_file for this snap is: volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e10462-5d35-4061-90b1-5788977d0d79]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Flow 'volume_create_manager' (689c0c56-2786-4082-9841-0588643d599f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612e5d45-c9f7-4b92-b7fd-f5b0c807a374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:22 devstack sudo[96142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a
Jul 03 12:56:22 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612e5d45-c9f7-4b92-b7fd-f5b0c807a374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-717705911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d252dcd-dfc0-4072-92f2-c0aeca3e8856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fc92177be8426ba95262f11d3172c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:23Z,use_quota=True,user_id='f793dfdd5b8a4b9199055c04746f5b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90016ef9-a8ca-4466-8934-3d0bea57e032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90016ef9-a8ca-4466-8934-3d0bea57e032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badbece8-fd5a-4c3e-b745-79e1dd5673aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badbece8-fd5a-4c3e-b745-79e1dd5673aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d252dcd-dfc0-4072-92f2-c0aeca3e8856', 'volume_name': 'volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b96b97-b0b1-4c3d-8351-29541e59d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b96b97-b0b1-4c3d-8351-29541e59d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57693ec1-a288-403c-b2e2-ce8e5e14d5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:22 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Volume 8d252dcd-dfc0-4072-92f2-c0aeca3e8856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856', 'volume_size': 1}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:22 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290 1073741824" returned: 0 in 1.247s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:22 devstack sudo[96144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290
Jul 03 12:56:22 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:23 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a" returned: 0 in 0.981s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-000246f5-e262-4b74-adb3-a7870ee30525(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b146c4-d9e0-42bf-b851-e91b562a4ea2]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:23 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:23 devstack sudo[96150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525
Jul 03 12:56:23 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290" returned: 0 in 0.841s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-717705911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d252dcd-dfc0-4072-92f2-c0aeca3e8856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fc92177be8426ba95262f11d3172c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:23Z,use_quota=True,user_id='f793dfdd5b8a4b9199055c04746f5b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Creating volume 8d252dcd-dfc0-4072-92f2-c0aeca3e8856 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:56:23 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:23 devstack sudo[96152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856 1073741824
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ed2ebc-19f6-4f18-a9cb-4c03b3e35f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a818a6d9-d855-4146-8322-b66a2c01d290', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:23 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e505b448-3371-438e-a8c7-72175a7af91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Volume volume-a818a6d9-d855-4146-8322-b66a2c01d290 (a818a6d9-d855-4146-8322-b66a2c01d290): created successfully
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e505b448-3371-438e-a8c7-72175a7af91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Flow 'volume_create_manager' (26d5df2b-15f3-4bd8-8d85-4a475fd7e876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:56:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fbf12a6f-d0de-47db-9c3a-fbeb12af1ea3 tempest-VolumesMetadataTest-1289022409 None] Created volume successfully.
Jul 03 12:56:24 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525" returned: 0 in 1.062s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:24 devstack sudo[96160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a
Jul 03 12:56:24 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:24 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856 1073741824" returned: 0 in 1.115s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:24 devstack sudo[96162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856
Jul 03 12:56:24 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Acquiring lock "cinder-a818a6d9-d855-4146-8322-b66a2c01d290-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Lock "cinder-a818a6d9-d855-4146-8322-b66a2c01d290-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Acquiring lock "cinder-quobyte-a818a6d9-d855-4146-8322-b66a2c01d290" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:56:25 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856" returned: 0 in 0.796s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Lock "cinder-quobyte-a818a6d9-d855-4146-8322-b66a2c01d290" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57693ec1-a288-403c-b2e2-ce8e5e14d5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34827dc-783c-4a10-9a2d-b08d08585123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a11a2fd-db59-4698-a7c7-bd9587dbd3eb]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Volume volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856 (8d252dcd-dfc0-4072-92f2-c0aeca3e8856): created successfully
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34827dc-783c-4a10-9a2d-b08d08585123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Flow 'volume_create_manager' (689c0c56-2786-4082-9841-0588643d599f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:56:25 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a" returned: 0 in 1.172s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9a46c92d-3b77-4cd9-83d4-a2d5a5567313 tempest-ServersNegativeTestJSON-1518126226 None] Created volume successfully.
Jul 03 12:56:25 devstack sudo[96169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a
Jul 03 12:56:25 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:25 devstack sudo[96168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290
Jul 03 12:56:25 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:26 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525.08164bba-c276-4da6-baee-50dd5429a07a" returned: 0 in 0.758s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:26 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290" returned: 0 in 0.905s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Lock "cinder-quobyte-08164bba-c276-4da6-baee-50dd5429a07a" released by "_delete_snapshot" :: held 4.196s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Lock "cinder-quobyte-000246f5-e262-4b74-adb3-a7870ee30525" released by "delete_snapshot" :: held 4.240s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:26 devstack sudo[96176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290
Jul 03 12:56:26 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:26 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Created reservations ['6c06dbbb-bc51-45ad-9a85-f80f5ac962ad', 'c6af7e67-2795-4051-aa63-0be7e122d07c', '78c710c7-056f-4413-86d5-04bfbb1e1161', '0fcb94de-5f05-4177-ae86-c763f11b09f8'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:56:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Delete snapshot completed successfully.
Jul 03 12:56:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7993027e-392e-45b7-805b-d07954ec3aab tempest-VolumesExtendTest-1705985643 None] Lock "cinder-08164bba-c276-4da6-baee-50dd5429a07a-delete_snapshot" released by "delete_snapshot" :: held 4.499s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Acquiring lock "cinder-8d252dcd-dfc0-4072-92f2-c0aeca3e8856-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:56:27 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a818a6d9-d855-4146-8322-b66a2c01d290" returned: 0 in 1.136s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Lock "cinder-8d252dcd-dfc0-4072-92f2-c0aeca3e8856-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:56:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Lock "cinder-quobyte-a818a6d9-d855-4146-8322-b66a2c01d290" released by "delete_volume" :: held 2.133s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Acquiring lock "cinder-quobyte-8d252dcd-dfc0-4072-92f2-c0aeca3e8856" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:56:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Lock "cinder-quobyte-8d252dcd-dfc0-4072-92f2-c0aeca3e8856" acquired by "delete_volume" :: waited 0.049s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:56:27 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Created reservations ['da18ac40-f438-4357-9b6e-7282f7574472', '5e8bf38e-ed82-478d-8142-70c9d082ebe2', '0f4f653b-0155-4869-9f4d-be53aa4f3116', 'dcd5789d-18a4-45c7-bf9b-63d09ce7f611'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:56:27 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7502a3bf-40f6-4c35-bef6-33d35c032494]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:56:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Acquiring lock "cinder-000246f5-e262-4b74-adb3-a7870ee30525-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Lock "cinder-000246f5-e262-4b74-adb3-a7870ee30525-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:28 devstack sudo[96179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856
Jul 03 12:56:28 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Acquiring lock "cinder-quobyte-000246f5-e262-4b74-adb3-a7870ee30525" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:56:28 devstack sudo[96182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:56:28 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Lock "cinder-quobyte-000246f5-e262-4b74-adb3-a7870ee30525" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8223a13f-26fd-4291-9d37-a08fadb0501a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:56:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:28 devstack sudo[96184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525
Jul 03 12:56:28 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:29 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.124s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:29 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:56:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Deleted volume successfully.
Jul 03 12:56:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7c6d8e75-fe0e-444b-9bbf-2588833ec009 tempest-VolumesMetadataTest-1289022409 None] Lock "cinder-a818a6d9-d855-4146-8322-b66a2c01d290-delete_volume" released by "delete_volume" :: held 3.765s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:29 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856" returned: 0 in 1.575s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:29 devstack sudo[96206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856
Jul 03 12:56:29 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:29 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525" returned: 0 in 1.600s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:29 devstack sudo[96214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525
Jul 03 12:56:29 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:30 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8d252dcd-dfc0-4072-92f2-c0aeca3e8856" returned: 0 in 1.037s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Lock "cinder-quobyte-8d252dcd-dfc0-4072-92f2-c0aeca3e8856" released by "delete_volume" :: held 2.707s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Created reservations ['ce4ca0a5-01ce-4681-a2b1-64c8f0099553', 'ded08f8d-6955-4495-ad20-013541c055c5', '230d6ef0-4178-4943-8bc1-573f7f18a51a', '3f501ace-304b-4ea7-9e69-71696e461387'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:56:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:30 devstack sudo[96217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:56:30 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:30 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-000246f5-e262-4b74-adb3-a7870ee30525" returned: 0 in 1.056s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Lock "cinder-quobyte-000246f5-e262-4b74-adb3-a7870ee30525" released by "delete_volume" :: held 2.782s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=65,cinder:INSERT=26,cinder:UPDATE=77,cinder:DELETE=4 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=63,cinder:INSERT=22,cinder:UPDATE=78,cinder:DELETE=7 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Created reservations ['6118c543-c991-4f14-8f1b-fb853aa41ab8', '0df53d43-b811-40fe-b9b7-ef9b938ae9cf', 'f0380d3e-a2d3-4059-8bfc-2585e89bfc76', '6da092c2-0df3-4ae7-b8da-468d99a1bd8c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:31 devstack sudo[96220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:56:31 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Acquiring lock "cinder-f5109e79-a453-4ced-9e2f-cb890059be33-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Lock "cinder-f5109e79-a453-4ced-9e2f-cb890059be33-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Acquiring lock "cinder-quobyte-f5109e79-a453-4ced-9e2f-cb890059be33" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Lock "cinder-quobyte-f5109e79-a453-4ced-9e2f-cb890059be33" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd00cc77-4c1c-48f8-b504-b38be6210ff6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:31 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.972s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:56:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Deleted volume successfully.
Jul 03 12:56:31 devstack sudo[96223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33
Jul 03 12:56:31 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-32b3d4bc-ec09-4960-bceb-d9f5c59ca64e tempest-ServersNegativeTestJSON-1518126226 None] Lock "cinder-8d252dcd-dfc0-4072-92f2-c0aeca3e8856-delete_volume" released by "delete_volume" :: held 4.038s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:32 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.177s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:32 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:56:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Deleted volume successfully.
Jul 03 12:56:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-027fd37a-d74f-4049-a020-48ba7e58563e tempest-VolumesExtendTest-1705985643 None] Lock "cinder-000246f5-e262-4b74-adb3-a7870ee30525-delete_volume" released by "delete_volume" :: held 4.372s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:33 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33" returned: 0 in 1.553s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:33 devstack sudo[96229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33
Jul 03 12:56:33 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:34 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f5109e79-a453-4ced-9e2f-cb890059be33" returned: 0 in 0.937s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Lock "cinder-quobyte-f5109e79-a453-4ced-9e2f-cb890059be33" released by "delete_volume" :: held 2.580s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:34 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Created reservations ['b20c19b4-94ed-462b-9a16-645a4dc3255f', '3d290f00-52b3-499e-a9ff-b9c99cad9231', '684a7f20-f96b-4853-a45c-d5a15c427bea', '17eae270-7a18-46d6-8419-2a9a62ba4c69'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:56:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:34 devstack sudo[96236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:56:34 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:35 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.100s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:35 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:56:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Deleted volume successfully.
Jul 03 12:56:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-be079fe0-9320-40c5-8160-082b784803bc tempest-ServersNegativeTestJSON-1518126226 None] Lock "cinder-f5109e79-a453-4ced-9e2f-cb890059be33-delete_volume" released by "delete_volume" :: held 4.099s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:56:40 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:56:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Flow 'volume_create_manager' (dded23f8-2914-440a-b047-d3e67c31449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:56:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314f957d-4cc8-42bf-a6b6-6b5fda9caa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314f957d-4cc8-42bf-a6b6-6b5fda9caa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1710496664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46907bd-4b6b-4022-90dd-f1e4638a77a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1809863287746189bba16727daa105b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:41Z,use_quota=True,user_id='261b083608ca4fccb4655e04694db64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0392d2ca-1bf8-4e32-886f-89c2f29e97ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0392d2ca-1bf8-4e32-886f-89c2f29e97ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c622dcdf-e9c5-4db4-b07d-4b6a0cec77a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c622dcdf-e9c5-4db4-b07d-4b6a0cec77a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46907bd-4b6b-4022-90dd-f1e4638a77a2', 'volume_name': 'volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67cd9e8-4d59-4717-89c4-300848745ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67cd9e8-4d59-4717-89c4-300848745ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e87ee32-6609-4e6d-93f9-8232fa3bde20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:41 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Volume c46907bd-4b6b-4022-90dd-f1e4638a77a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2', 'volume_size': 1}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1710496664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46907bd-4b6b-4022-90dd-f1e4638a77a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1809863287746189bba16727daa105b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:56:41Z,use_quota=True,user_id='261b083608ca4fccb4655e04694db64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Creating volume c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:56:41 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:56:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:41 devstack sudo[96348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 1073741824
Jul 03 12:56:41 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:42 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 1073741824" returned: 0 in 1.378s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:42 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2
Jul 03 12:56:42 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:43 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2" returned: 0 in 1.148s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] <== create_volume: return (2631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:56:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.633s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e87ee32-6609-4e6d-93f9-8232fa3bde20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da1c9f8-bd0a-4590-9633-576fb7645b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:56:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Volume volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 (c46907bd-4b6b-4022-90dd-f1e4638a77a2): created successfully
Jul 03 12:56:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da1c9f8-bd0a-4590-9633-576fb7645b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:56:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Flow 'volume_create_manager' (dded23f8-2914-440a-b047-d3e67c31449a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:56:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e1257a0f-6505-4180-8d77-d39b05e854c9 tempest-VolumesSnapshotListTestJSON-1868772591 None] Created volume successfully.
Jul 03 12:56:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] Creating offline snapshot ffcd5455-df9f-4023-a774-654b26edb32a of volume c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:56:44 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6075f6d6-7998-49c8-9d24-df2f82fe72e4]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:56:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:45 devstack sudo[96361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2
Jul 03 12:56:45 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:46 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2" returned: 0 in 1.192s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:46 devstack sudo[96367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a 1G
Jul 03 12:56:46 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:47 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a 1G" returned: 0 in 1.322s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:47 devstack sudo[96375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a
Jul 03 12:56:47 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:48 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a" returned: 0 in 0.942s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:48 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a is being set with open permissions: ugo+rw
Jul 03 12:56:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:48 devstack sudo[96385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a
Jul 03 12:56:48 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:49 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a" returned: 0 in 0.975s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:49 devstack sudo[96389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.info
Jul 03 12:56:49 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:50 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.info" returned: 0 in 1.207s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:50 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.info is being set with open permissions: ugo+rw
Jul 03 12:56:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:50 devstack sudo[96394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.info
Jul 03 12:56:50 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.info" returned: 0 in 1.462s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:52 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.295s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ffd2badb-f97c-4278-bc94-42a050d369ff tempest-VolumesSnapshotListTestJSON-1868772591 None] Create snapshot completed successfully
Jul 03 12:56:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] Creating offline snapshot 4a2f48d9-a1d1-4595-9fda-8977b9d68e5d of volume c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:56:53 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df02777-2a4b-46c7-9419-a3f28c01795c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:56:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:53 devstack sudo[96452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a
Jul 03 12:56:53 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:54 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a" returned: 0 in 1.075s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:56:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:54 devstack sudo[96458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d 1G
Jul 03 12:56:54 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:56 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d 1G" returned: 0 in 1.397s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:56 devstack sudo[96464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d
Jul 03 12:56:56 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:57 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d" returned: 0 in 1.082s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:57 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d is being set with open permissions: ugo+rw
Jul 03 12:56:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:57 devstack sudo[96472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d
Jul 03 12:56:57 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:58 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d" returned: 0 in 1.009s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.765s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2f7b26da-3e31-4a8f-be8e-7d403fc97a38 tempest-VolumesSnapshotListTestJSON-1868772591 None] Create snapshot completed successfully
Jul 03 12:56:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Creating offline snapshot 5f3758a6-d09b-4906-9de4-bf8d13013478 of volume c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:56:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[40014a7e-3d3f-47a2-a1f0-d104818afa43]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:56:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:59 devstack sudo[96476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d
Jul 03 12:56:59 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:00 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d" returned: 0 in 1.243s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:57:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:00 devstack sudo[96483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478 1G
Jul 03 12:57:00 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:02 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478 1G" returned: 0 in 1.420s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:02 devstack sudo[96491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478
Jul 03 12:57:02 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:03 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478" returned: 0 in 0.926s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:03 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478 is being set with open permissions: ugo+rw
Jul 03 12:57:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:03 devstack sudo[96502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478
Jul 03 12:57:03 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:04 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478" returned: 0 in 0.900s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.732s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-044a7b57-4dea-415f-a558-b40346ba85d2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Create snapshot completed successfully
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:05 devstack sudo[96507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:57:05 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Flow 'volume_create_manager' (0d47133c-a981-4f60-91ce-b07f2788ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ea3563-5307-4c02-b4c1-f51f2f8e65a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ea3563-5307-4c02-b4c1-f51f2f8e65a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1508019458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d1fab7-847d-45aa-986b-387fff6d327d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77b57b5383d4aa485a5db40729909c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:57:06Z,use_quota=True,user_id='4b6b2c4e671e4148a127aec7e673f632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8c84e0-6e3b-4620-9968-ae8ae329f97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8c84e0-6e3b-4620-9968-ae8ae329f97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6042fb91-bd21-43a4-8eb0-cfc5a0d64c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6042fb91-bd21-43a4-8eb0-cfc5a0d64c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d1fab7-847d-45aa-986b-387fff6d327d', 'volume_name': 'volume-22d1fab7-847d-45aa-986b-387fff6d327d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9779615-8f44-4772-b7d1-8df8a84c7230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9779615-8f44-4772-b7d1-8df8a84c7230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5301fa-e680-448e-bf97-70dc52896e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Volume 22d1fab7-847d-45aa-986b-387fff6d327d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d1fab7-847d-45aa-986b-387fff6d327d', 'volume_size': 1}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1508019458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d1fab7-847d-45aa-986b-387fff6d327d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77b57b5383d4aa485a5db40729909c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:57:06Z,use_quota=True,user_id='4b6b2c4e671e4148a127aec7e673f632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Creating volume 22d1fab7-847d-45aa-986b-387fff6d327d {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:57:05 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:57:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:06 devstack sudo[96510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d 1073741824
Jul 03 12:57:06 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:06 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.238s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "cinder-5f3758a6-d09b-4906-9de4-bf8d13013478-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-5f3758a6-d09b-4906-9de4-bf8d13013478-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "cinder-quobyte-5f3758a6-d09b-4906-9de4-bf8d13013478" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-5f3758a6-d09b-4906-9de4-bf8d13013478" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Deleting offline snapshot 5f3758a6-d09b-4906-9de4-bf8d13013478 of volume c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] snapshot_file for this snap is: volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[becca51f-aabb-4f4b-aa0e-106ea062103e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:06 devstack sudo[96512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478
Jul 03 12:57:06 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:07 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d 1073741824" returned: 0 in 1.865s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:07 devstack sudo[96520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d
Jul 03 12:57:07 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:07 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478" returned: 0 in 1.288s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:57:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5be45dd-a64d-4e66-90da-0d171e276013]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:08 devstack sudo[96522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d
Jul 03 12:57:08 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:08 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d" returned: 0 in 1.116s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] <== create_volume: return (3059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:57:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.062s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5301fa-e680-448e-bf97-70dc52896e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d1fab7-847d-45aa-986b-387fff6d327d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08eb3867-0042-4b3b-aa86-eba584e7c76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Volume volume-22d1fab7-847d-45aa-986b-387fff6d327d (22d1fab7-847d-45aa-986b-387fff6d327d): created successfully
Jul 03 12:57:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08eb3867-0042-4b3b-aa86-eba584e7c76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Flow 'volume_create_manager' (0d47133c-a981-4f60-91ce-b07f2788ef14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:57:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8ac2344f-a66a-4e3d-ad22-417bba4d7c8d tempest-AttachVolumeNegativeTest-1679123321 None] Created volume successfully.
Jul 03 12:57:09 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d" returned: 0 in 1.286s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:57:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:09 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478
Jul 03 12:57:09 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:10 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478" returned: 0 in 1.235s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:10 devstack sudo[96539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478
Jul 03 12:57:10 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:11 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.5f3758a6-d09b-4906-9de4-bf8d13013478" returned: 0 in 1.000s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-5f3758a6-d09b-4906-9de4-bf8d13013478" released by "_delete_snapshot" :: held 5.011s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" released by "delete_snapshot" :: held 5.070s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:11 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Created reservations ['c8c37daa-9892-4602-b8de-60d20730759d', 'e5c4203b-7e4c-4ad9-809c-d7e08a0b2f07', '2e190c29-0197-4d7e-b3a7-bd3dce366d35', '8233282b-7ae1-4c7a-a91c-5f050fe9d952'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:57:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Delete snapshot completed successfully.
Jul 03 12:57:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-888bf437-ff56-4a0a-a916-415ab4eb5dc3 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-5f3758a6-d09b-4906-9de4-bf8d13013478-delete_snapshot" released by "delete_snapshot" :: held 5.287s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "cinder-4a2f48d9-a1d1-4595-9fda-8977b9d68e5d-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-4a2f48d9-a1d1-4595-9fda-8977b9d68e5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "cinder-quobyte-4a2f48d9-a1d1-4595-9fda-8977b9d68e5d" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-4a2f48d9-a1d1-4595-9fda-8977b9d68e5d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Deleting offline snapshot 4a2f48d9-a1d1-4595-9fda-8977b9d68e5d of volume c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:57:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] snapshot_file for this snap is: volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:57:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d85a5f-5161-4ea6-b4e6-5feb21a717db]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:12 devstack sudo[96542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d
Jul 03 12:57:12 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:13 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d" returned: 0 in 1.370s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:57:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21aed43-bb64-45ca-a855-56a897855b25]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:13 devstack sudo[96548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a
Jul 03 12:57:13 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-a51cb11c-91b3-4cda-82e4-f6d234b75a4e req-a39dd8a2-8db0-4fd4-95a1-d35e0fbcef3d tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:57:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-a51cb11c-91b3-4cda-82e4-f6d234b75a4e req-a39dd8a2-8db0-4fd4-95a1-d35e0fbcef3d tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:57:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8414c9-e3ee-41ad-9f1d-28b8e8942887]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-a51cb11c-91b3-4cda-82e4-f6d234b75a4e req-a39dd8a2-8db0-4fd4-95a1-d35e0fbcef3d tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:14 devstack sudo[96558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d
Jul 03 12:57:14 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:14 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a" returned: 0 in 1.270s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:57:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:14 devstack sudo[96563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d
Jul 03 12:57:14 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:15 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-a51cb11c-91b3-4cda-82e4-f6d234b75a4e req-a39dd8a2-8db0-4fd4-95a1-d35e0fbcef3d tempest-AttachVolumeNegativeTest-1679123321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d" returned: 0 in 1.120s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-a51cb11c-91b3-4cda-82e4-f6d234b75a4e req-a39dd8a2-8db0-4fd4-95a1-d35e0fbcef3d tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.151s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-a51cb11c-91b3-4cda-82e4-f6d234b75a4e req-a39dd8a2-8db0-4fd4-95a1-d35e0fbcef3d tempest-AttachVolumeNegativeTest-1679123321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-22d1fab7-847d-45aa-986b-387fff6d327d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f23a8653-888e-45c3-8be3-248eed34db23', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:57:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-a51cb11c-91b3-4cda-82e4-f6d234b75a4e req-a39dd8a2-8db0-4fd4-95a1-d35e0fbcef3d tempest-AttachVolumeNegativeTest-1679123321 None] attachment_update completed successfully.
Jul 03 12:57:16 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d" returned: 0 in 1.523s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:16 devstack sudo[96639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d
Jul 03 12:57:16 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:17 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.4a2f48d9-a1d1-4595-9fda-8977b9d68e5d" returned: 0 in 0.969s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-4a2f48d9-a1d1-4595-9fda-8977b9d68e5d" released by "_delete_snapshot" :: held 5.310s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" released by "delete_snapshot" :: held 5.353s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:17 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Created reservations ['2fc3c2a1-b73a-49b7-9670-530e7e735229', '500cff0d-fce9-44a5-97e7-2a6e30015c5a', 'c9524d10-c81c-433c-9515-7a63754fec03', 'bc67b5a3-e8c5-473d-b34a-c06699d5bcff'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:57:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Delete snapshot completed successfully.
Jul 03 12:57:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7493e53e-046e-44c5-b334-baff89f707a2 tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-4a2f48d9-a1d1-4595-9fda-8977b9d68e5d-delete_snapshot" released by "delete_snapshot" :: held 5.587s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "cinder-ffcd5455-df9f-4023-a774-654b26edb32a-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-ffcd5455-df9f-4023-a774-654b26edb32a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "cinder-quobyte-ffcd5455-df9f-4023-a774-654b26edb32a" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-ffcd5455-df9f-4023-a774-654b26edb32a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Deleting offline snapshot ffcd5455-df9f-4023-a774-654b26edb32a of volume c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:57:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] snapshot_file for this snap is: volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:57:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0d49dc-1c85-4518-8359-3b4bed413ca2]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:18 devstack sudo[96957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a
Jul 03 12:57:18 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:19 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a" returned: 0 in 1.158s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:57:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[850b06d9-58cd-45c7-ab45-6016b71bf3a1]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:19 devstack sudo[96962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2
Jul 03 12:57:19 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:21 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2" returned: 0 in 1.461s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:21 devstack sudo[96968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a
Jul 03 12:57:21 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Flow 'volume_create_manager' (556a3907-c1ad-4aba-97c0-33f15e40e2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c545bbea-b615-4c8a-925b-6b208f0c15ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c545bbea-b615-4c8a-925b-6b208f0c15ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1820805267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ab4e71-61a0-48f2-b00b-62dead99e642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beb6fc2952ba4902ad46618d0c3a8c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:57:22Z,use_quota=True,user_id='c8947c1f710243baa20d272dd47215d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bd368a-e573-42b3-9bf5-2d37107e12f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bd368a-e573-42b3-9bf5-2d37107e12f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62bede1-7dd4-4818-94e4-7013bfd5a742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62bede1-7dd4-4818-94e4-7013bfd5a742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ab4e71-61a0-48f2-b00b-62dead99e642', 'volume_name': 'volume-83ab4e71-61a0-48f2-b00b-62dead99e642', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf72bb40-8692-4241-831f-ec950d961739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf72bb40-8692-4241-831f-ec950d961739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c320a2-6596-40d6-b895-357119b88982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:21 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Volume 83ab4e71-61a0-48f2-b00b-62dead99e642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ab4e71-61a0-48f2-b00b-62dead99e642', 'volume_size': 1}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1820805267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ab4e71-61a0-48f2-b00b-62dead99e642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beb6fc2952ba4902ad46618d0c3a8c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:57:22Z,use_quota=True,user_id='c8947c1f710243baa20d272dd47215d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Creating volume 83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:57:21 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:57:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:21 devstack sudo[96971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 1073741824
Jul 03 12:57:21 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:22 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a" returned: 0 in 1.539s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:22 devstack sudo[96981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a
Jul 03 12:57:22 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-b1849b14-3d36-4ff1-857e-113e7bb156de req-7ec27b35-bae1-4d12-86f9-d4bd0c06c927 tempest-AttachVolumeNegativeTest-1679123321 None] Terminate volume connection completed successfully.
Jul 03 12:57:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-b1849b14-3d36-4ff1-857e-113e7bb156de req-7ec27b35-bae1-4d12-86f9-d4bd0c06c927 tempest-AttachVolumeNegativeTest-1679123321 None] Deleting attachment f23a8653-888e-45c3-8be3-248eed34db23. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:57:23 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 1073741824" returned: 0 in 1.658s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:23 devstack sudo[97017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642
Jul 03 12:57:23 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:23 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2.ffcd5455-df9f-4023-a774-654b26edb32a" returned: 0 in 1.151s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-ffcd5455-df9f-4023-a774-654b26edb32a" released by "_delete_snapshot" :: held 5.495s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" released by "delete_snapshot" :: held 5.525s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Created reservations ['9a6f7cc7-dd8c-4a74-a400-32bbe94c32e0', 'd005d82d-a122-4a63-b28d-57c462f764c0', '28299d9b-2951-48e2-b64c-ccd2e17f1aeb', 'b9f7fa4a-d905-476d-a0a6-729d54af163b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:57:24 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Delete snapshot completed successfully.
Jul 03 12:57:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aeb8104a-4b8a-410f-adf6-c745627022dd tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-ffcd5455-df9f-4023-a774-654b26edb32a-delete_snapshot" released by "delete_snapshot" :: held 5.822s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:24 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642" returned: 0 in 1.010s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] <== create_volume: return (2738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:57:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.743s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c320a2-6596-40d6-b895-357119b88982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ab4e71-61a0-48f2-b00b-62dead99e642', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5c47f4-026c-46ad-b27f-6d8f65c3c432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:24 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Volume volume-83ab4e71-61a0-48f2-b00b-62dead99e642 (83ab4e71-61a0-48f2-b00b-62dead99e642): created successfully
Jul 03 12:57:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5c47f4-026c-46ad-b27f-6d8f65c3c432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Flow 'volume_create_manager' (556a3907-c1ad-4aba-97c0-33f15e40e2bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:57:24 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-56bd3a12-49ee-4f6d-a75f-93a6b3c7a3dc tempest-TestStampPattern-1506570535 None] Created volume successfully.
Jul 03 12:57:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "cinder-c46907bd-4b6b-4022-90dd-f1e4638a77a2-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-c46907bd-4b6b-4022-90dd-f1e4638a77a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bbc218-fc8f-4764-bc9b-5268cc396e5e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:25 devstack sudo[97021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2
Jul 03 12:57:25 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:26 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2" returned: 0 in 1.011s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:26 devstack sudo[97032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2
Jul 03 12:57:26 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:27 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c46907bd-4b6b-4022-90dd-f1e4638a77a2" returned: 0 in 1.176s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-quobyte-c46907bd-4b6b-4022-90dd-f1e4638a77a2" released by "delete_volume" :: held 2.321s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:27 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Created reservations ['76d705b1-36b7-406b-829f-3ed687b701a7', '5609348f-1355-4ebf-9eb2-32203661f4ea', '12cfd4d8-f71a-4df0-b0c8-5da9da7d363c', 'ca04d85b-51f8-4c1f-acd9-7cf6f06eacc9'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:57:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:57:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:57:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:57:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:57:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:28 devstack sudo[97070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:57:28 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:29 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.072s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:29 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:57:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Deleted volume successfully.
Jul 03 12:57:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-db00319b-5607-4bb3-b413-5f0dd55c360b tempest-VolumesSnapshotListTestJSON-1868772591 None] Lock "cinder-c46907bd-4b6b-4022-90dd-f1e4638a77a2-delete_volume" released by "delete_volume" :: held 3.689s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=55,cinder:INSERT=15,cinder:UPDATE=53,cinder:DELETE=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=57,cinder:SELECT=44,cinder:DELETE=7,cinder:INSERT=13 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Flow 'volume_create_manager' (185b0d09-9474-482f-a185-cd5ce3f6e17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d55e08-14e5-4de5-8232-4b74903a103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d55e08-14e5-4de5-8232-4b74903a103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1640139639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c35656-bbdf-471e-970c-c20ef6a6b4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faf9faa44d940739f11262a9f2e0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:57:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:57:35Z,use_quota=True,user_id='d19eaa7b79024825a6e72f2be501cc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124f8a32-2608-41d5-a754-71ed57dc4c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124f8a32-2608-41d5-a754-71ed57dc4c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e63b49-7cf9-4444-b25e-e2c16ce4cb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e63b49-7cf9-4444-b25e-e2c16ce4cb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c35656-bbdf-471e-970c-c20ef6a6b4f9', 'volume_name': 'volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9', 'volume_size': 2}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac17d28-6feb-4fe8-bfb9-60f1ce14ccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac17d28-6feb-4fe8-bfb9-60f1ce14ccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aee17a7-ea95-4f2d-85e0-763227c9a124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Volume 29c35656-bbdf-471e-970c-c20ef6a6b4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9', 'volume_size': 2}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1640139639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c35656-bbdf-471e-970c-c20ef6a6b4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faf9faa44d940739f11262a9f2e0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:57:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:57:35Z,use_quota=True,user_id='d19eaa7b79024825a6e72f2be501cc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Creating volume 29c35656-bbdf-471e-970c-c20ef6a6b4f9 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:57:35 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:57:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 2147483648 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:35 devstack sudo[97095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 2147483648
Jul 03 12:57:35 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:36 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 2147483648" returned: 0 in 1.350s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:36 devstack sudo[97101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9
Jul 03 12:57:36 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:37 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9" returned: 0 in 1.040s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] <== create_volume: return (2452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:57:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.454s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aee17a7-ea95-4f2d-85e0-763227c9a124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9', 'volume_size': 2}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a27115-7f93-4434-960f-fbb84d69cd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:57:37 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Volume volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 (29c35656-bbdf-471e-970c-c20ef6a6b4f9): created successfully
Jul 03 12:57:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a27115-7f93-4434-960f-fbb84d69cd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:57:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Flow 'volume_create_manager' (185b0d09-9474-482f-a185-cd5ce3f6e17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:57:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1001c956-1576-40d6-957f-4c0f283e8fdf tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Created volume successfully.
Jul 03 12:57:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:57:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:57:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Creating offline snapshot 1495c795-53db-41cd-9d71-edac4464a507 of volume 29c35656-bbdf-471e-970c-c20ef6a6b4f9 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:57:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ae3f82-bd3b-472d-a223-1b5248bb272d]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:39 devstack sudo[97108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9
Jul 03 12:57:39 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:40 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9" returned: 0 in 1.816s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507 2G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:40 devstack sudo[97177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507 2G
Jul 03 12:57:40 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:42 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507 2G" returned: 0 in 2.172s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:42 devstack sudo[97198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507
Jul 03 12:57:42 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:44 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507" returned: 0 in 1.423s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:44 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507 is being set with open permissions: ugo+rw
Jul 03 12:57:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:44 devstack sudo[97203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507
Jul 03 12:57:44 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:45 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507" returned: 0 in 1.357s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:45 devstack sudo[97207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.info
Jul 03 12:57:45 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:47 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.info" returned: 0 in 1.267s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:47 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.info is being set with open permissions: ugo+rw
Jul 03 12:57:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:47 devstack sudo[97210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.info
Jul 03 12:57:47 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:48 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.info" returned: 0 in 1.147s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.420s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-380e1baf-5eff-4f16-be34-756ce2817e95 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Create snapshot completed successfully
Jul 03 12:57:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Acquiring lock "cinder-1495c795-53db-41cd-9d71-edac4464a507-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "cinder-1495c795-53db-41cd-9d71-edac4464a507-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Acquiring lock "cinder-quobyte-29c35656-bbdf-471e-970c-c20ef6a6b4f9" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "cinder-quobyte-29c35656-bbdf-471e-970c-c20ef6a6b4f9" acquired by "delete_snapshot" :: waited 0.071s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Acquiring lock "cinder-quobyte-1495c795-53db-41cd-9d71-edac4464a507" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "cinder-quobyte-1495c795-53db-41cd-9d71-edac4464a507" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Deleting offline snapshot 1495c795-53db-41cd-9d71-edac4464a507 of volume 29c35656-bbdf-471e-970c-c20ef6a6b4f9 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:57:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] snapshot_file for this snap is: volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:57:49 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b17cba4-7b6f-4e3a-bd39-95fd98bfa3e6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:49 devstack sudo[97214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507
Jul 03 12:57:49 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:50 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507" returned: 0 in 1.489s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:57:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4595c48d-0142-43e6-80a7-6c6b550956f1]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:51 devstack sudo[97222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9
Jul 03 12:57:51 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:52 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9" returned: 0 in 1.577s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:52 devstack sudo[97277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507
Jul 03 12:57:52 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:54 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507" returned: 0 in 1.588s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:54 devstack sudo[97284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507
Jul 03 12:57:54 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:55 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9.1495c795-53db-41cd-9d71-edac4464a507" returned: 0 in 1.749s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "cinder-quobyte-1495c795-53db-41cd-9d71-edac4464a507" released by "_delete_snapshot" :: held 6.649s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "cinder-quobyte-29c35656-bbdf-471e-970c-c20ef6a6b4f9" released by "delete_snapshot" :: held 6.734s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:55 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Created reservations ['229945f7-1877-4809-9f88-3b9ea3bf9ea8', '06785e1e-4b83-4570-9191-9c6616e99714', '6f4dc8ca-dbf6-4dfa-b05b-b1c8d52f818e', '7a028d21-860c-4010-ac80-50a6357a41e2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:57:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Delete snapshot completed successfully.
Jul 03 12:57:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13ba5e54-3dd9-4bc5-b3d3-faf610b92e6c tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "cinder-1495c795-53db-41cd-9d71-edac4464a507-delete_snapshot" released by "delete_snapshot" :: held 7.039s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Acquiring lock "cinder-29c35656-bbdf-471e-970c-c20ef6a6b4f9-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "cinder-29c35656-bbdf-471e-970c-c20ef6a6b4f9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Acquiring lock "cinder-quobyte-29c35656-bbdf-471e-970c-c20ef6a6b4f9" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:57:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "cinder-quobyte-29c35656-bbdf-471e-970c-c20ef6a6b4f9" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:57:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7e9b77-377c-42d2-996d-80375d50b068]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:57:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:57 devstack sudo[97304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9
Jul 03 12:57:57 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:58 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9" returned: 0 in 1.144s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:58 devstack sudo[97310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9
Jul 03 12:57:58 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:57:58 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root
Jul 03 12:57:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-29c35656-bbdf-471e-970c-c20ef6a6b4f9" returned: 0 in 0.826s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:57:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "cinder-quobyte-29c35656-bbdf-471e-970c-c20ef6a6b4f9" released by "delete_volume" :: held 2.054s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:57:59 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Created reservations ['936ef294-072f-41bd-b855-6c9dae691a34', '62d1fd6d-b2c6-465e-9eb5-0f64cc191267', '2261af7f-8ff6-404f-99a1-6f11a277c10e', 'be73121e-4505-4be7-a132-95fad1eeede4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:57:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:57:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:57:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:57:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:57:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:57:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:57:59 devstack sudo[97314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:57:59 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:00 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.031s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:00 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:58:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Deleted volume successfully.
Jul 03 12:58:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e9c455a4-2093-4ab4-9cae-d0414bb05362 tempest-VolumesSnapshotNegativeTestJSON-2075012905 None] Lock "cinder-29c35656-bbdf-471e-970c-c20ef6a6b4f9-delete_volume" released by "delete_volume" :: held 3.453s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:58:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:58:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:58:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:58:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:05 devstack sudo[97397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:58:05 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:06 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.726s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:58:09 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:58:10 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=15,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:58:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-ecfec92a-aee0-4518-b8f6-2168e42100e8 req-e949d78f-df3f-4f29-897f-30726fbdb196 tempest-TestStampPattern-1506570535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-ecfec92a-aee0-4518-b8f6-2168e42100e8 req-e949d78f-df3f-4f29-897f-30726fbdb196 tempest-TestStampPattern-1506570535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3284b09c-c8e5-404e-901d-26af473edca8]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:58:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-ecfec92a-aee0-4518-b8f6-2168e42100e8 req-e949d78f-df3f-4f29-897f-30726fbdb196 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:13 devstack sudo[97419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642
Jul 03 12:58:13 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:14 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-ecfec92a-aee0-4518-b8f6-2168e42100e8 req-e949d78f-df3f-4f29-897f-30726fbdb196 tempest-TestStampPattern-1506570535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642" returned: 0 in 1.336s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-ecfec92a-aee0-4518-b8f6-2168e42100e8 req-e949d78f-df3f-4f29-897f-30726fbdb196 tempest-TestStampPattern-1506570535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.374s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-ecfec92a-aee0-4518-b8f6-2168e42100e8 req-e949d78f-df3f-4f29-897f-30726fbdb196 tempest-TestStampPattern-1506570535 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-83ab4e71-61a0-48f2-b00b-62dead99e642', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1386628-a401-4cc1-be9d-ab1bc20915d3', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:58:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-ecfec92a-aee0-4518-b8f6-2168e42100e8 req-e949d78f-df3f-4f29-897f-30726fbdb196 tempest-TestStampPattern-1506570535 None] attachment_update completed successfully.
Jul 03 12:58:24 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:58:24 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:58:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-12d6af3f-7329-4d7e-8750-077fa2dbd74f req-dbfef64b-7486-4767-942b-d7bd16794898 tempest-TestStampPattern-1506570535 None] Terminate volume connection completed successfully.
Jul 03 12:58:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-12d6af3f-7329-4d7e-8750-077fa2dbd74f req-dbfef64b-7486-4767-942b-d7bd16794898 tempest-TestStampPattern-1506570535 None] Deleting attachment f1386628-a401-4cc1-be9d-ab1bc20915d3. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:58:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] Creating offline snapshot d32d7331-bf88-44e2-af71-b0a595f09196 of volume 83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:58:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[788b5191-f090-45e4-a2e0-79261b7be0fc]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:58:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:28 devstack sudo[97904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642
Jul 03 12:58:28 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:29 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642" returned: 0 in 1.243s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:29 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196 1G
Jul 03 12:58:29 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:31 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196 1G" returned: 0 in 1.528s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ab4e71-61a0-48f2-b00b-62dead99e642 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:31 devstack sudo[97978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ab4e71-61a0-48f2-b00b-62dead99e642 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196
Jul 03 12:58:31 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:32 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ab4e71-61a0-48f2-b00b-62dead99e642 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196" returned: 0 in 1.516s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:32 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196 is being set with open permissions: ugo+rw
Jul 03 12:58:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:32 devstack sudo[97991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196
Jul 03 12:58:32 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:33 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196" returned: 0 in 1.061s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:34 devstack sudo[97994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.info
Jul 03 12:58:34 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (862a43ff-c56f-499a-bfc7-9fd4756570aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f50cbca-13bb-4bc9-8c17-b503f462aed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f50cbca-13bb-4bc9-8c17-b503f462aed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1334232802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4654d60-b58f-47f5-aade-8312dd1033e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:35Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3956102c-5bdd-4888-aa73-83cc3500ac01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3956102c-5bdd-4888-aa73-83cc3500ac01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d27da1d-c4be-49e5-b116-fb3144ed2fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d27da1d-c4be-49e5-b116-fb3144ed2fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4654d60-b58f-47f5-aade-8312dd1033e4', 'volume_name': 'volume-b4654d60-b58f-47f5-aade-8312dd1033e4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374a2678-9818-4f7d-ac62-a19a3309371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374a2678-9818-4f7d-ac62-a19a3309371e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b948952-4d13-46c9-9fb2-c44e3e24340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Volume b4654d60-b58f-47f5-aade-8312dd1033e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4654d60-b58f-47f5-aade-8312dd1033e4', 'volume_size': 1}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Flow 'volume_create_manager' (b7f883eb-cb83-4ba5-b4d2-1fc55e291951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975f8865-6ea9-4c42-b894-f48d9808d23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:35 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975f8865-6ea9-4c42-b894-f48d9808d23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1738067459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9372072e-9f30-4098-a275-782e55ca3f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77b57b5383d4aa485a5db40729909c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:36Z,use_quota=True,user_id='4b6b2c4e671e4148a127aec7e673f632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02ec53d-81c0-43e3-9cd8-97722dc11de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02ec53d-81c0-43e3-9cd8-97722dc11de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d95563-1d1f-444e-8d31-190305af55e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d95563-1d1f-444e-8d31-190305af55e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9372072e-9f30-4098-a275-782e55ca3f06', 'volume_name': 'volume-9372072e-9f30-4098-a275-782e55ca3f06', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4857a2-8e74-4f74-b85d-f63a8d371e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4857a2-8e74-4f74-b85d-f63a8d371e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40538ac5-d8bd-4547-a7e4-8f81644b88cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Volume 9372072e-9f30-4098-a275-782e55ca3f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9372072e-9f30-4098-a275-782e55ca3f06', 'volume_size': 1}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.info" returned: 0 in 1.910s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:35 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.info is being set with open permissions: ugo+rw
Jul 03 12:58:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:35 devstack sudo[97999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.info
Jul 03 12:58:35 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:37 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.info" returned: 0 in 1.105s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.607s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.650s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1334232802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4654d60-b58f-47f5-aade-8312dd1033e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:35Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Creating volume b4654d60-b58f-47f5-aade-8312dd1033e4 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:58:37 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:58:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:37 devstack sudo[98002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4 1073741824
Jul 03 12:58:37 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d00f2094-d96b-41c8-88ac-c848fce82773 tempest-TestStampPattern-1506570535 None] Create snapshot completed successfully
Jul 03 12:58:38 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4 1073741824" returned: 0 in 1.505s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:38 devstack sudo[98007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4
Jul 03 12:58:38 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:41 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4" returned: 0 in 2.218s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] <== create_volume: return (3844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.863s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.139s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1738067459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9372072e-9f30-4098-a275-782e55ca3f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77b57b5383d4aa485a5db40729909c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:36Z,use_quota=True,user_id='4b6b2c4e671e4148a127aec7e673f632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Creating volume 9372072e-9f30-4098-a275-782e55ca3f06 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:58:41 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:41 devstack sudo[98013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06 1073741824
Jul 03 12:58:41 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b948952-4d13-46c9-9fb2-c44e3e24340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4654d60-b58f-47f5-aade-8312dd1033e4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4388b3b-57aa-4d17-8f13-b5b9df0e6413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:41 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Volume volume-b4654d60-b58f-47f5-aade-8312dd1033e4 (b4654d60-b58f-47f5-aade-8312dd1033e4): created successfully
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4388b3b-57aa-4d17-8f13-b5b9df0e6413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (862a43ff-c56f-499a-bfc7-9fd4756570aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:58:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fe0387a3-dc12-4cba-93e1-3fb6abdb138b tempest-VolumesActionsTest-384004545 None] Created volume successfully.
Jul 03 12:58:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-689f4744-43cf-48d5-859c-574c03927bb0 tempest-VolumesActionsTest-384004545 None] Acquiring lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4" by "attach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:58:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-689f4744-43cf-48d5-859c-574c03927bb0 tempest-VolumesActionsTest-384004545 None] Lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4" acquired by "attach_volume" :: waited 0.055s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:58:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-689f4744-43cf-48d5-859c-574c03927bb0 tempest-VolumesActionsTest-384004545 None] Attaching volume b4654d60-b58f-47f5-aade-8312dd1033e4 to instance c3b26af4-de0a-4fbb-9f50-6c632ce2103e at mountpoint /dev/vdb on host None.
Jul 03 12:58:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-689f4744-43cf-48d5-859c-574c03927bb0 tempest-VolumesActionsTest-384004545 None] Attach volume completed successfully.
Jul 03 12:58:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-689f4744-43cf-48d5-859c-574c03927bb0 tempest-VolumesActionsTest-384004545 None] Lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4" released by "attach_volume" :: held 0.334s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:58:43 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06 1073741824" returned: 0 in 2.549s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:43 devstack sudo[98043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06
Jul 03 12:58:43 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c3eedc6d-80de-4108-97d3-e69646b43dba tempest-VolumesActionsTest-1712287117 None] Terminate volume connection completed successfully.
Jul 03 12:58:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c3eedc6d-80de-4108-97d3-e69646b43dba tempest-VolumesActionsTest-1712287117 None] Acquiring lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4-detach_volume" by "detach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:58:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c3eedc6d-80de-4108-97d3-e69646b43dba tempest-VolumesActionsTest-1712287117 None] Lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:58:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c3eedc6d-80de-4108-97d3-e69646b43dba tempest-VolumesActionsTest-1712287117 None] Detaching volume b4654d60-b58f-47f5-aade-8312dd1033e4 from instance c3b26af4-de0a-4fbb-9f50-6c632ce2103e.
Jul 03 12:58:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c3eedc6d-80de-4108-97d3-e69646b43dba tempest-VolumesActionsTest-1712287117 None] Detach volume completed successfully.
Jul 03 12:58:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c3eedc6d-80de-4108-97d3-e69646b43dba tempest-VolumesActionsTest-1712287117 None] Lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4-detach_volume" released by "detach_volume" :: held 0.169s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:58:45 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06" returned: 0 in 1.341s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] <== create_volume: return (4001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:58:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40538ac5-d8bd-4547-a7e4-8f81644b88cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9372072e-9f30-4098-a275-782e55ca3f06', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a964d59-3a4d-4aaf-8163-880d9c1531d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:45 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Volume volume-9372072e-9f30-4098-a275-782e55ca3f06 (9372072e-9f30-4098-a275-782e55ca3f06): created successfully
Jul 03 12:58:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a964d59-3a4d-4aaf-8163-880d9c1531d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Flow 'volume_create_manager' (b7f883eb-cb83-4ba5-b4d2-1fc55e291951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:58:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-47893ea7-59f5-46b1-8194-ef28580b07db tempest-AttachVolumeNegativeTest-1679123321 None] Created volume successfully.
Jul 03 12:58:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d3de555-859a-4dda-a630-43615b1ecd66 tempest-VolumesActionsTest-384004545 None] Acquiring lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4-detach_volume" by "detach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:58:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d3de555-859a-4dda-a630-43615b1ecd66 tempest-VolumesActionsTest-384004545 None] Lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:58:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2d3de555-859a-4dda-a630-43615b1ecd66 tempest-VolumesActionsTest-384004545 None] Volume detach called, but volume not attached.
Jul 03 12:58:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d3de555-859a-4dda-a630-43615b1ecd66 tempest-VolumesActionsTest-384004545 None] Lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4-detach_volume" released by "detach_volume" :: held 0.053s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:58:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Acquiring lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:58:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:58:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Acquiring lock "cinder-quobyte-b4654d60-b58f-47f5-aade-8312dd1033e4" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:58:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Lock "cinder-quobyte-b4654d60-b58f-47f5-aade-8312dd1033e4" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:58:46 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cb7fc8-77ee-47d3-a85d-692a95922e84]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:58:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:46 devstack sudo[98113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4
Jul 03 12:58:46 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:47 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4" returned: 0 in 1.301s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:47 devstack sudo[98121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4
Jul 03 12:58:47 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:49 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b4654d60-b58f-47f5-aade-8312dd1033e4" returned: 0 in 1.409s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Lock "cinder-quobyte-b4654d60-b58f-47f5-aade-8312dd1033e4" released by "delete_volume" :: held 2.833s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:58:49 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Created reservations ['c9abf175-9afc-409b-be2a-485c7c65b80a', '02f730e5-cb6e-45a6-a67f-1660c729980d', '214e400b-3c98-41d0-bf8e-fc0d0b467ae3', '06266eda-47c1-4653-a77c-289e52a11427'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:58:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:58:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:58:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:49 devstack sudo[98124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:58:49 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-2430ba0c-ffb3-464d-a2e8-38b6f7751761 req-353043c4-ac36-4aa2-933c-512889c897aa tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-2430ba0c-ffb3-464d-a2e8-38b6f7751761 req-353043c4-ac36-4aa2-933c-512889c897aa tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d87b91-1f17-49b2-b4ee-fc1465b03c80]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:58:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-2430ba0c-ffb3-464d-a2e8-38b6f7751761 req-353043c4-ac36-4aa2-933c-512889c897aa tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:50 devstack sudo[98135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06
Jul 03 12:58:50 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:50 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.275s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:50 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:58:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Deleted volume successfully.
Jul 03 12:58:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4dada3df-5e0d-4f72-a97f-cc56e833bfa9 tempest-VolumesActionsTest-384004545 None] Lock "cinder-b4654d60-b58f-47f5-aade-8312dd1033e4-delete_volume" released by "delete_volume" :: held 4.417s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:58:51 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-2430ba0c-ffb3-464d-a2e8-38b6f7751761 req-353043c4-ac36-4aa2-933c-512889c897aa tempest-AttachVolumeNegativeTest-1679123321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06" returned: 0 in 1.545s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-2430ba0c-ffb3-464d-a2e8-38b6f7751761 req-353043c4-ac36-4aa2-933c-512889c897aa tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.596s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-2430ba0c-ffb3-464d-a2e8-38b6f7751761 req-353043c4-ac36-4aa2-933c-512889c897aa tempest-AttachVolumeNegativeTest-1679123321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-9372072e-9f30-4098-a275-782e55ca3f06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbca21f8-be1f-47d4-b4c7-4af46cd8843f', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:58:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-2430ba0c-ffb3-464d-a2e8-38b6f7751761 req-353043c4-ac36-4aa2-933c-512889c897aa tempest-AttachVolumeNegativeTest-1679123321 None] attachment_update completed successfully.
Jul 03 12:58:52 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:58:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Flow 'volume_create_manager' (a9816ecd-6aab-4652-ad59-a560b210ad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:58:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883622eb-0910-4171-9dad-18d802938a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883622eb-0910-4171-9dad-18d802938a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-873060501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beb6fc2952ba4902ad46618d0c3a8c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d32d7331-bf88-44e2-af71-b0a595f09196,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:53Z,use_quota=True,user_id='c8947c1f710243baa20d272dd47215d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6d053d-6ba1-4796-a102-bb2ad468fc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6d053d-6ba1-4796-a102-bb2ad468fc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6fc3f4-d90f-443a-bc58-1d0e84ea1719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6fc3f4-d90f-443a-bc58-1d0e84ea1719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6', 'volume_name': 'volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6', 'volume_size': 1, 'snapshot_id': 'd32d7331-bf88-44e2-af71-b0a595f09196'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9eefaec-ada4-42a8-9b80-1f8e71e75858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9eefaec-ada4-42a8-9b80-1f8e71e75858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0804c6d-9f0c-476b-aa41-c895ed84e886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Volume a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6', 'volume_size': 1, 'snapshot_id': 'd32d7331-bf88-44e2-af71-b0a595f09196'}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Acquiring lock "cinder-quobyte-d32d7331-bf88-44e2-af71-b0a595f09196-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-d32d7331-bf88-44e2-af71-b0a595f09196-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Creating volume a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6 from snapshot d32d7331-bf88-44e2-af71-b0a595f09196 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Acquiring lock "cinder-quobyte-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] snapshot: d32d7331-bf88-44e2-af71-b0a595f09196, volume: a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40347e4-95ec-48c4-b90a-9230a1659877]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:58:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:53 devstack sudo[98597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196
Jul 03 12:58:53 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:54 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196" returned: 0 in 1.286s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83ab4e71-61a0-48f2-b00b-62dead99e642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:58:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 12:58:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 12:58:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22f5225-d994-4cec-8533-f6e56e814145]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:58:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:54 devstack sudo[98608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642
Jul 03 12:58:54 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:55 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642" returned: 0 in 1.061s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:55 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 12:58:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:55 devstack sudo[98617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6
Jul 03 12:58:55 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-410f86c3-e045-4190-849c-88828beb2ada req-20d29574-96cf-41b0-bc53-62a58935bdf9 tempest-AttachVolumeNegativeTest-1679123321 None] Terminate volume connection completed successfully.
Jul 03 12:58:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-410f86c3-e045-4190-849c-88828beb2ada req-20d29574-96cf-41b0-bc53-62a58935bdf9 tempest-AttachVolumeNegativeTest-1679123321 None] Deleting attachment fbca21f8-be1f-47d4-b4c7-4af46cd8843f. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (3537ae3a-9b96-44ba-b27f-12e99d2f3c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bbecf6-6720-42c9-84cd-5223a90ee425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bbecf6-6720-42c9-84cd-5223a90ee425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1393363651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75002584-c180-4ac6-9ab5-1d69fafe7bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:01Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbaceef-1e21-4e3e-9a63-005efd439d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbaceef-1e21-4e3e-9a63-005efd439d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3994c8f0-99bd-4e45-9dc0-d2ed9c176384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3994c8f0-99bd-4e45-9dc0-d2ed9c176384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75002584-c180-4ac6-9ab5-1d69fafe7bb4', 'volume_name': 'volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48749d8-4ecd-4b03-acc7-0cf9c933bf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48749d8-4ecd-4b03-acc7-0cf9c933bf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea6b289-dc4a-41e9-a36e-f9dfa333b800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Volume 75002584-c180-4ac6-9ab5-1d69fafe7bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4', 'volume_size': 1}
Jul 03 12:59:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:03 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" returned: 0 in 7.829s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc19a7ad-34c8-4c24-a3c4-8358fd507ab8]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:03 devstack sudo[98666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642
Jul 03 12:59:03 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:59:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:05 devstack sudo[98711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:59:05 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:05 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642" returned: 0 in 1.981s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:05 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642, size 1024.00 MB, duration 7.83 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 12:59:05 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Converted 1024.00 MB image at 130.77 MB/s
Jul 03 12:59:05 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6 is being set with open permissions: ugo+rw
Jul 03 12:59:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:05 devstack sudo[98715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6
Jul 03 12:59:05 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:06 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.142s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:59:07 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" returned: 0 in 1.515s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" released by "_copy_volume_from_snapshot" :: held 13.885s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-d32d7331-bf88-44e2-af71-b0a595f09196-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" released by "_create_volume_from_snapshot" :: held 13.955s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.985s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.227s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1393363651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75002584-c180-4ac6-9ab5-1d69fafe7bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:01Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Creating volume 75002584-c180-4ac6-9ab5-1d69fafe7bb4 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:59:07 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:07 devstack sudo[98736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4 1073741824
Jul 03 12:59:07 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0804c6d-9f0c-476b-aa41-c895ed84e886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6', 'volume_size': 1, 'snapshot_id': 'd32d7331-bf88-44e2-af71-b0a595f09196'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401cf010-956e-4f4f-a79e-0fd118d1260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Volume volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6 (a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6): created successfully
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401cf010-956e-4f4f-a79e-0fd118d1260a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Flow 'volume_create_manager' (a9816ecd-6aab-4652-ad59-a560b210ad35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-70cb974c-13e7-435d-a582-1bf08a7d471e tempest-TestStampPattern-1506570535 None] Created volume successfully.
Jul 03 12:59:08 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4 1073741824" returned: 0 in 1.436s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:08 devstack sudo[98783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4
Jul 03 12:59:08 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:09 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4" returned: 0 in 1.035s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] <== create_volume: return (2533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:59:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.537s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea6b289-dc4a-41e9-a36e-f9dfa333b800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221ddcff-d036-433c-88c5-a35cd2f2cce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Volume volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4 (75002584-c180-4ac6-9ab5-1d69fafe7bb4): created successfully
Jul 03 12:59:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221ddcff-d036-433c-88c5-a35cd2f2cce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (3537ae3a-9b96-44ba-b27f-12e99d2f3c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-368c6edb-465a-49f4-9342-a1d611c56c1c tempest-VolumesActionsTest-384004545 None] Created volume successfully.
Jul 03 12:59:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Acquiring lock "cinder-75002584-c180-4ac6-9ab5-1d69fafe7bb4-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Lock "cinder-75002584-c180-4ac6-9ab5-1d69fafe7bb4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Acquiring lock "cinder-quobyte-75002584-c180-4ac6-9ab5-1d69fafe7bb4" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Lock "cinder-quobyte-75002584-c180-4ac6-9ab5-1d69fafe7bb4" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[103ffecd-bb14-4446-a3b2-a565587ff93f]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:10 devstack sudo[98793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4
Jul 03 12:59:10 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:11 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4" returned: 0 in 1.094s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:11 devstack sudo[98808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4
Jul 03 12:59:11 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:12 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75002584-c180-4ac6-9ab5-1d69fafe7bb4" returned: 0 in 0.711s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Lock "cinder-quobyte-75002584-c180-4ac6-9ab5-1d69fafe7bb4" released by "delete_volume" :: held 1.854s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:12 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Created reservations ['ad2649ae-4659-4d7b-82ee-2f8557a14d1f', '6ceafbff-3746-47ba-9af5-897bc423733b', '2a5a41e2-5ca4-4015-b806-8d608af692e4', '60350c43-6c93-4e49-9f3f-dd46654f842b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:12 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:59:12 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:13 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:59:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (e723d04a-d700-4c78-b746-90954ce2a0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d55abd-fe09-48fe-b1a1-f884f3ada10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d55abd-fe09-48fe-b1a1-f884f3ada10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1564636641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31fafa2d-cfe9-4ea0-bf60-313604121117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:14Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4bd017-4a08-4773-a476-f50473d8bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4bd017-4a08-4773-a476-f50473d8bebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abcd3d8-43bc-47ca-8679-7706256db563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abcd3d8-43bc-47ca-8679-7706256db563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31fafa2d-cfe9-4ea0-bf60-313604121117', 'volume_name': 'volume-31fafa2d-cfe9-4ea0-bf60-313604121117', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5ee8e3-c07f-447a-81b2-fee6408c047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5ee8e3-c07f-447a-81b2-fee6408c047a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b631f9-e9ce-4cc9-9575-47ca9d860238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:14 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Volume 31fafa2d-cfe9-4ea0-bf60-313604121117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31fafa2d-cfe9-4ea0-bf60-313604121117', 'volume_size': 1}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1564636641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31fafa2d-cfe9-4ea0-bf60-313604121117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:14Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Creating volume 31fafa2d-cfe9-4ea0-bf60-313604121117 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:59:14 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:14 devstack sudo[98917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117 1073741824
Jul 03 12:59:14 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:14 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.808s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:59:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Deleted volume successfully.
Jul 03 12:59:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c1ee459-fe46-4936-b637-750ef1c71849 tempest-VolumesActionsTest-1712287117 None] Lock "cinder-75002584-c180-4ac6-9ab5-1d69fafe7bb4-delete_volume" released by "delete_volume" :: held 4.089s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:16 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117 1073741824" returned: 0 in 2.765s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:17 devstack sudo[98937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117
Jul 03 12:59:17 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "cinder-9372072e-9f30-4098-a275-782e55ca3f06-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-9372072e-9f30-4098-a275-782e55ca3f06-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "cinder-quobyte-9372072e-9f30-4098-a275-782e55ca3f06" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-quobyte-9372072e-9f30-4098-a275-782e55ca3f06" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[339ad6c7-ef22-4c27-a368-172c993e2dca]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:18 devstack sudo[98940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06
Jul 03 12:59:18 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:19 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117" returned: 0 in 2.143s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] <== create_volume: return (4990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:59:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b631f9-e9ce-4cc9-9575-47ca9d860238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31fafa2d-cfe9-4ea0-bf60-313604121117', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da878033-eefc-4ccb-87c0-170e335d4e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:19 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Volume volume-31fafa2d-cfe9-4ea0-bf60-313604121117 (31fafa2d-cfe9-4ea0-bf60-313604121117): created successfully
Jul 03 12:59:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da878033-eefc-4ccb-87c0-170e335d4e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (e723d04a-d700-4c78-b746-90954ce2a0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-064655f8-7add-42a0-88b0-eba60d8c730f tempest-VolumesActionsTest-384004545 None] Created volume successfully.
Jul 03 12:59:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Acquiring lock "cinder-31fafa2d-cfe9-4ea0-bf60-313604121117-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Lock "cinder-31fafa2d-cfe9-4ea0-bf60-313604121117-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Acquiring lock "cinder-quobyte-31fafa2d-cfe9-4ea0-bf60-313604121117" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Lock "cinder-quobyte-31fafa2d-cfe9-4ea0-bf60-313604121117" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcbbc86-c727-41be-b172-ec800724ca54]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:20 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06" returned: 0 in 1.903s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:20 devstack sudo[98948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06
Jul 03 12:59:20 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:20 devstack sudo[98947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117
Jul 03 12:59:20 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:22 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117" returned: 0 in 1.547s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:22 devstack sudo[98955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117
Jul 03 12:59:22 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:22 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9372072e-9f30-4098-a275-782e55ca3f06" returned: 0 in 2.271s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-quobyte-9372072e-9f30-4098-a275-782e55ca3f06" released by "delete_volume" :: held 4.318s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:22 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Created reservations ['9c620328-c11c-4bfc-91ab-bfcb607317e4', 'f4c1e786-4bbe-41e1-88a1-4396f4db68a0', 'cfff91df-9a3d-4612-aa01-5b730846920f', 'a148aad7-30b1-4d44-8a37-8eac87526300'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:23 devstack sudo[98959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:59:23 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "cinder-22d1fab7-847d-45aa-986b-387fff6d327d-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-22d1fab7-847d-45aa-986b-387fff6d327d-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "cinder-quobyte-22d1fab7-847d-45aa-986b-387fff6d327d" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-quobyte-22d1fab7-847d-45aa-986b-387fff6d327d" acquired by "delete_volume" :: waited 0.060s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:24 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a4e9cc-523c-4627-989e-815de99f8147]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-31fafa2d-cfe9-4ea0-bf60-313604121117" returned: 0 in 2.400s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:24 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Flow 'volume_create_manager' (b7bca333-5ebf-4b70-a699-c097270a4a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded3bccf-7983-45f0-a450-006c1be6c9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Lock "cinder-quobyte-31fafa2d-cfe9-4ea0-bf60-313604121117" released by "delete_volume" :: held 4.100s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.348s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:59:24 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Deleted volume successfully.
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded3bccf-7983-45f0-a450-006c1be6c9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1475749705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6194f3b-ec5d-44c3-bb94-8e42acc2ad58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47318a8db81b40caa92ed9cf843eb9c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:24Z,use_quota=True,user_id='18b00fde5f7148b3adc871411b170833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4729da6-728a-4801-ac35-c851c1c828d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4729da6-728a-4801-ac35-c851c1c828d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4011ce-c009-4fd6-a1a9-51ce31f67297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4011ce-c009-4fd6-a1a9-51ce31f67297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6194f3b-ec5d-44c3-bb94-8e42acc2ad58', 'volume_name': 'volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479e1a83-445a-4bcf-916b-f3226977961a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479e1a83-445a-4bcf-916b-f3226977961a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74699bee-339e-4fcf-92c8-974bc6bc3c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:24 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Volume e6194f3b-ec5d-44c3-bb94-8e42acc2ad58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58', 'volume_size': 1}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1475749705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6194f3b-ec5d-44c3-bb94-8e42acc2ad58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47318a8db81b40caa92ed9cf843eb9c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:24Z,use_quota=True,user_id='18b00fde5f7148b3adc871411b170833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Creating volume e6194f3b-ec5d-44c3-bb94-8e42acc2ad58 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:59:24 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:24 devstack sudo[98964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d
Jul 03 12:59:24 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:24 devstack sudo[98966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58 1073741824
Jul 03 12:59:24 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0246bf3b-78b2-4ba6-833d-37e1e3b66d26 tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-9372072e-9f30-4098-a275-782e55ca3f06-delete_volume" released by "delete_volume" :: held 6.407s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Created reservations ['0bb1b682-ef0d-49dd-bf0a-24807b1c5038', 'bfe063e1-cdae-4b51-b100-997709ab97e9', '8d268197-260c-4a05-85cd-64f4132e466e', 'a00dcef6-a847-4290-8729-edeb2621dbaa'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=42,cinder:UPDATE=57,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:59:24 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=58,cinder:INSERT=14,cinder:UPDATE=41,cinder:DELETE=4 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:59:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:25 devstack sudo[98969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:59:25 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58 1073741824" returned: 0 in 2.317s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:27 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:27 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (3a344609-682a-4e75-bf6d-b3420f776e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:27 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:27 devstack sudo[98978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58
Jul 03 12:59:27 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6080ea-2583-4fa8-8b9c-c43af20174ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.981s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d" returned: 0 in 2.951s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Deleted volume successfully.
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6080ea-2583-4fa8-8b9c-c43af20174ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-690846665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e17536-3581-4738-bb97-81932dd77abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:27Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21c4c51-c788-4869-a95d-32507d49e687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:27 devstack sudo[98980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21c4c51-c788-4869-a95d-32507d49e687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:27 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f3c4c1-ec27-4942-90d9-156787a1b0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f3c4c1-ec27-4942-90d9-156787a1b0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27e17536-3581-4738-bb97-81932dd77abb', 'volume_name': 'volume-27e17536-3581-4738-bb97-81932dd77abb', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0453844-b275-44df-bb43-303d5112684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0453844-b275-44df-bb43-303d5112684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7098dc1b-b460-49a3-bad6-835464208e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Volume 27e17536-3581-4738-bb97-81932dd77abb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27e17536-3581-4738-bb97-81932dd77abb', 'volume_size': 1}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fac86b25-dddf-4746-9ca6-980bbfde4fa1 tempest-VolumesActionsTest-1712287117 None] Lock "cinder-31fafa2d-cfe9-4ea0-bf60-313604121117-delete_volume" released by "delete_volume" :: held 7.169s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:28 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58" returned: 0 in 0.980s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] <== create_volume: return (3506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.509s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-690846665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e17536-3581-4738-bb97-81932dd77abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:27Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Creating volume 27e17536-3581-4738-bb97-81932dd77abb {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:59:28 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74699bee-339e-4fcf-92c8-974bc6bc3c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:28 devstack sudo[98983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb 1073741824
Jul 03 12:59:28 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0b12db-9671-42ad-9750-f29f7e363655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Volume volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58 (e6194f3b-ec5d-44c3-bb94-8e42acc2ad58): created successfully
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0b12db-9671-42ad-9750-f29f7e363655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Flow 'volume_create_manager' (b7bca333-5ebf-4b70-a699-c097270a4a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ec656110-bc7f-4846-9855-6327cc6cf5bb tempest-TestMinimumBasicScenario-1292755471 None] Created volume successfully.
Jul 03 12:59:28 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-22d1fab7-847d-45aa-986b-387fff6d327d" returned: 0 in 1.412s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-quobyte-22d1fab7-847d-45aa-986b-387fff6d327d" released by "delete_volume" :: held 4.521s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Created reservations ['a9683881-78e9-4faa-a011-f4fa28513012', 'a467731f-2956-4bea-92e8-977ccc91323b', '64f847eb-c710-44f6-a800-feaa6e4b70cb', 'ddfa445f-6d53-4a44-94e3-2ad1f337022a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:29 devstack sudo[98986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:59:29 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "cinder-273ab365-6d3b-42b6-9dbc-d2526daa44f0-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-273ab365-6d3b-42b6-9dbc-d2526daa44f0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "cinder-quobyte-273ab365-6d3b-42b6-9dbc-d2526daa44f0" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-quobyte-273ab365-6d3b-42b6-9dbc-d2526daa44f0" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3905aafb-254b-4df7-9bb7-d0721aed129e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:30 devstack sudo[98992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0
Jul 03 12:59:30 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:30 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb 1073741824" returned: 0 in 2.025s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:30 devstack sudo[98998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb
Jul 03 12:59:30 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:30 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.746s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:59:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Deleted volume successfully.
Jul 03 12:59:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b6ec9af1-28de-468f-a72f-eadf9497b8fe tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-22d1fab7-847d-45aa-986b-387fff6d327d-delete_volume" released by "delete_volume" :: held 6.882s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:31 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0" returned: 0 in 1.512s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:31 devstack sudo[99016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0
Jul 03 12:59:31 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:31 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb" returned: 0 in 1.236s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] <== create_volume: return (3478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:59:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.490s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7098dc1b-b460-49a3-bad6-835464208e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e17536-3581-4738-bb97-81932dd77abb', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122fac66-def3-4213-b82d-6abb64d8aeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Volume volume-27e17536-3581-4738-bb97-81932dd77abb (27e17536-3581-4738-bb97-81932dd77abb): created successfully
Jul 03 12:59:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122fac66-def3-4213-b82d-6abb64d8aeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (3a344609-682a-4e75-bf6d-b3420f776e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ca566187-bda4-4024-b3ec-c4d6d13f809a tempest-VolumesActionsTest-384004545 None] Created volume successfully.
Jul 03 12:59:32 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-273ab365-6d3b-42b6-9dbc-d2526daa44f0" returned: 0 in 0.868s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-quobyte-273ab365-6d3b-42b6-9dbc-d2526daa44f0" released by "delete_volume" :: held 2.454s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:32 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Created reservations ['68879ad3-c296-4ed6-b4f5-1cba75a15994', 'c349a64d-f97a-4987-8d78-022a2b9cea23', 'bfc7a92d-163e-4c7b-afc5-49da6d33d325', '265d9f6b-09ca-4c5a-a7d2-e094ed653c1a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:32 devstack sudo[99021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:59:32 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Acquiring lock "cinder-27e17536-3581-4738-bb97-81932dd77abb-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Lock "cinder-27e17536-3581-4738-bb97-81932dd77abb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Acquiring lock "cinder-quobyte-27e17536-3581-4738-bb97-81932dd77abb" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Lock "cinder-quobyte-27e17536-3581-4738-bb97-81932dd77abb" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[472448c7-751f-4074-af1f-92c1ac90a012]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:33 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.965s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:59:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Deleted volume successfully.
Jul 03 12:59:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e89b02fd-3d24-4c9b-93ee-ce0041e8c46f tempest-AttachVolumeNegativeTest-1679123321 None] Lock "cinder-273ab365-6d3b-42b6-9dbc-d2526daa44f0-delete_volume" released by "delete_volume" :: held 3.759s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:33 devstack sudo[99059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb
Jul 03 12:59:33 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-0a1523cb-739a-4f38-a611-465a88e1a4a0 req-0dc080b9-3274-40d2-b06f-d4dd48befd97 tempest-TestMinimumBasicScenario-1292755471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-0a1523cb-739a-4f38-a611-465a88e1a4a0 req-0dc080b9-3274-40d2-b06f-d4dd48befd97 tempest-TestMinimumBasicScenario-1292755471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[715784ed-50ad-4ad8-a4cd-66b0e810e97c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-0a1523cb-739a-4f38-a611-465a88e1a4a0 req-0dc080b9-3274-40d2-b06f-d4dd48befd97 tempest-TestMinimumBasicScenario-1292755471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:33 devstack sudo[99069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58
Jul 03 12:59:33 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:34 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb" returned: 0 in 1.016s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:34 devstack sudo[99075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb
Jul 03 12:59:34 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:34 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-0a1523cb-739a-4f38-a611-465a88e1a4a0 req-0dc080b9-3274-40d2-b06f-d4dd48befd97 tempest-TestMinimumBasicScenario-1292755471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58" returned: 0 in 0.883s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-0a1523cb-739a-4f38-a611-465a88e1a4a0 req-0dc080b9-3274-40d2-b06f-d4dd48befd97 tempest-TestMinimumBasicScenario-1292755471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.913s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-0a1523cb-739a-4f38-a611-465a88e1a4a0 req-0dc080b9-3274-40d2-b06f-d4dd48befd97 tempest-TestMinimumBasicScenario-1292755471 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f17cec66-9d3b-4132-83d0-c36fd5e065b8', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:59:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-0a1523cb-739a-4f38-a611-465a88e1a4a0 req-0dc080b9-3274-40d2-b06f-d4dd48befd97 tempest-TestMinimumBasicScenario-1292755471 None] attachment_update completed successfully.
Jul 03 12:59:34 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-27e17536-3581-4738-bb97-81932dd77abb" returned: 0 in 0.844s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Lock "cinder-quobyte-27e17536-3581-4738-bb97-81932dd77abb" released by "delete_volume" :: held 1.961s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Created reservations ['0646d9ab-62fc-45d6-b23a-b96fa92ecebd', 'fc6e76d3-2b45-4634-bcf3-aa7753308430', 'ef35b758-22ea-4680-abe7-52020bf4cec6', 'a3a6c893-3c2e-416f-a7bc-9fb0dc8cc827'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:35 devstack sudo[99146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:59:35 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (89a2891d-e7d4-40dd-97d6-fa1b7c5f1c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1795b2-6e19-4464-969f-7df9299c1889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1795b2-6e19-4464-969f-7df9299c1889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1532202639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5821a9-ece0-4fb1-9973-1b9a8183c2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:36Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c8f443-f1e6-4d88-990b-9299e3c577a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c8f443-f1e6-4d88-990b-9299e3c577a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69a5236-e5f2-4561-84f5-017979b71edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69a5236-e5f2-4561-84f5-017979b71edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf5821a9-ece0-4fb1-9973-1b9a8183c2fb', 'volume_name': 'volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cde6c36-410c-4c5f-a955-6afd70243a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cde6c36-410c-4c5f-a955-6afd70243a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b514c2f-bcdf-41eb-af5b-c9c4a1953a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:36 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Volume bf5821a9-ece0-4fb1-9973-1b9a8183c2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb', 'volume_size': 1}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1532202639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5821a9-ece0-4fb1-9973-1b9a8183c2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:36Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Creating volume bf5821a9-ece0-4fb1-9973-1b9a8183c2fb {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:59:36 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:36 devstack sudo[99468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb 1073741824
Jul 03 12:59:36 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:36 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.235s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:59:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Deleted volume successfully.
Jul 03 12:59:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f793e2da-652f-4bc9-8e62-e7b907d7184a tempest-VolumesActionsTest-1712287117 None] Lock "cinder-27e17536-3581-4738-bb97-81932dd77abb-delete_volume" released by "delete_volume" :: held 3.577s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:37 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb 1073741824" returned: 0 in 0.966s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:37 devstack sudo[99473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb
Jul 03 12:59:37 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:38 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb" returned: 0 in 0.781s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:59:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b514c2f-bcdf-41eb-af5b-c9c4a1953a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60566bc2-0878-48a6-bf17-d57b5284b56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Volume volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb (bf5821a9-ece0-4fb1-9973-1b9a8183c2fb): created successfully
Jul 03 12:59:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60566bc2-0878-48a6-bf17-d57b5284b56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (89a2891d-e7d4-40dd-97d6-fa1b7c5f1c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5bb05415-3120-48fa-96a9-68697a8eaf58 tempest-VolumesActionsTest-384004545 None] Created volume successfully.
Jul 03 12:59:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Acquiring lock "cinder-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Lock "cinder-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Acquiring lock "cinder-quobyte-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Lock "cinder-quobyte-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77b1dce-7a31-480d-98b2-55e409848561]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:39 devstack sudo[99477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb
Jul 03 12:59:39 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:41 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb" returned: 0 in 1.308s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:41 devstack sudo[99489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb
Jul 03 12:59:41 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:42 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb" returned: 0 in 1.052s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Lock "cinder-quobyte-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb" released by "delete_volume" :: held 2.459s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:42 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Created reservations ['4275420b-4120-4acc-a61b-fd4cd9ffd34a', 'cce74a09-1e24-44c9-8fcb-04a779f624eb', '4567e6ae-0204-4e92-ab18-e940f7c81147', '130ff920-b9c6-4bf8-9b31-6b1f5f19e897'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:42 devstack sudo[99500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:59:42 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:43 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.541s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:43 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:59:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Deleted volume successfully.
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4344b0f4-8428-4259-81ad-f4458f169eef tempest-VolumesActionsTest-1712287117 None] Lock "cinder-bf5821a9-ece0-4fb1-9973-1b9a8183c2fb-delete_volume" released by "delete_volume" :: held 4.494s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (e8041205-4cfa-4d2b-b5c3-2a67a75a18e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a061e645-5e0e-47b6-a4f0-b2ea665fef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a061e645-5e0e-47b6-a4f0-b2ea665fef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1411172754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a256d239-09e9-45c0-997e-68a1f5fdf113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:44Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941836a0-192d-48a9-a6ce-7eb278c97de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941836a0-192d-48a9-a6ce-7eb278c97de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caab223f-5087-46e1-b4de-cc7d1d13f8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caab223f-5087-46e1-b4de-cc7d1d13f8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a256d239-09e9-45c0-997e-68a1f5fdf113', 'volume_name': 'volume-a256d239-09e9-45c0-997e-68a1f5fdf113', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab96a83-63c9-4081-ad73-eda5bbecc431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab96a83-63c9-4081-ad73-eda5bbecc431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1122ad68-a03a-4b82-a2d0-dcabf5e52401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Volume a256d239-09e9-45c0-997e-68a1f5fdf113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a256d239-09e9-45c0-997e-68a1f5fdf113', 'volume_size': 1}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1411172754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a256d239-09e9-45c0-997e-68a1f5fdf113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5955df1304c444c091c369f6efaa086f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:44Z,use_quota=True,user_id='4fe9ac3193e5474b99d6940e9d9c2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Creating volume a256d239-09e9-45c0-997e-68a1f5fdf113 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:59:44 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:44 devstack sudo[99518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113 1073741824
Jul 03 12:59:44 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Flow 'volume_create_manager' (b12d3123-2bf7-4c86-a151-5ba3af78d6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffb10d0-2b0a-4ad5-9eba-19cdad388105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffb10d0-2b0a-4ad5-9eba-19cdad388105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1469410190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a969486-ab5a-4443-ba19-9a7fcd21a397,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='505951cae68240578298662f1ae19281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:45Z,use_quota=True,user_id='c085125a63c14bf095412072d762357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1237b5cc-b50d-43b4-a02d-6d8c4db6f282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1237b5cc-b50d-43b4-a02d-6d8c4db6f282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74091201-6370-4c14-8305-0a5acc51c42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74091201-6370-4c14-8305-0a5acc51c42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a969486-ab5a-4443-ba19-9a7fcd21a397', 'volume_name': 'volume-9a969486-ab5a-4443-ba19-9a7fcd21a397', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0551c5-62d6-4d03-90d9-01a7dbee3b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0551c5-62d6-4d03-90d9-01a7dbee3b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beaada77-1011-41d5-ad4c-f0b66a764655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Volume 9a969486-ab5a-4443-ba19-9a7fcd21a397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a969486-ab5a-4443-ba19-9a7fcd21a397', 'volume_size': 1}
Jul 03 12:59:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:45 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113 1073741824" returned: 0 in 1.293s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:45 devstack sudo[99526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113
Jul 03 12:59:45 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:46 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113" returned: 0 in 0.937s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] <== create_volume: return (2308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.601s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1469410190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a969486-ab5a-4443-ba19-9a7fcd21a397,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='505951cae68240578298662f1ae19281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:45Z,use_quota=True,user_id='c085125a63c14bf095412072d762357e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Creating volume 9a969486-ab5a-4443-ba19-9a7fcd21a397 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:59:46 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1122ad68-a03a-4b82-a2d0-dcabf5e52401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a256d239-09e9-45c0-997e-68a1f5fdf113', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:46 devstack sudo[99533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397 1073741824
Jul 03 12:59:46 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb34ebb0-a6b4-4942-85cf-fc57b74fff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Volume volume-a256d239-09e9-45c0-997e-68a1f5fdf113 (a256d239-09e9-45c0-997e-68a1f5fdf113): created successfully
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb34ebb0-a6b4-4942-85cf-fc57b74fff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Flow 'volume_create_manager' (e8041205-4cfa-4d2b-b5c3-2a67a75a18e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f818f54a-df30-44a5-bbae-dc897de6e08b tempest-VolumesActionsTest-384004545 None] Created volume successfully.
Jul 03 12:59:47 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397 1073741824" returned: 0 in 1.168s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:47 devstack sudo[99542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397
Jul 03 12:59:47 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Acquiring lock "cinder-a256d239-09e9-45c0-997e-68a1f5fdf113-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Lock "cinder-a256d239-09e9-45c0-997e-68a1f5fdf113-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Acquiring lock "cinder-quobyte-a256d239-09e9-45c0-997e-68a1f5fdf113" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Lock "cinder-quobyte-a256d239-09e9-45c0-997e-68a1f5fdf113" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[03966f58-e0a8-4938-a451-3597aa6a5a3b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:48 devstack sudo[99544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113
Jul 03 12:59:48 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:48 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397" returned: 0 in 1.005s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.246s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beaada77-1011-41d5-ad4c-f0b66a764655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a969486-ab5a-4443-ba19-9a7fcd21a397', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3421688c-a2c3-421b-a9f3-10a5789e05d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:48 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Volume volume-9a969486-ab5a-4443-ba19-9a7fcd21a397 (9a969486-ab5a-4443-ba19-9a7fcd21a397): created successfully
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3421688c-a2c3-421b-a9f3-10a5789e05d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Flow 'volume_create_manager' (b12d3123-2bf7-4c86-a151-5ba3af78d6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-33696540-817e-4204-b58f-1bc17c34f3d8 req-b580e0f4-07e0-4f0c-9ad4-952f2f2378f7 tempest-VolumesGetTestJSON-716532953 None] Created volume successfully.
Jul 03 12:59:49 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113" returned: 0 in 1.116s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:49 devstack sudo[99550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113
Jul 03 12:59:49 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Acquiring lock "cinder-9a969486-ab5a-4443-ba19-9a7fcd21a397-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Lock "cinder-9a969486-ab5a-4443-ba19-9a7fcd21a397-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Acquiring lock "cinder-quobyte-9a969486-ab5a-4443-ba19-9a7fcd21a397" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Lock "cinder-quobyte-9a969486-ab5a-4443-ba19-9a7fcd21a397" acquired by "delete_volume" :: waited 0.043s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:49 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c64c95b-bd7e-4951-978a-bde978bf8417]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-114fb144-bfd0-4257-badf-be39f96b7c07 req-5a5878ea-a20b-4ddc-924f-0def35feb8da tempest-TestStampPattern-1506570535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-114fb144-bfd0-4257-badf-be39f96b7c07 req-5a5878ea-a20b-4ddc-924f-0def35feb8da tempest-TestStampPattern-1506570535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a019d7a8-5efd-4e3a-b48c-512d0ebf2c03]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-114fb144-bfd0-4257-badf-be39f96b7c07 req-5a5878ea-a20b-4ddc-924f-0def35feb8da tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:50 devstack sudo[99561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397
Jul 03 12:59:50 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:50 devstack sudo[99564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6
Jul 03 12:59:50 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:50 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a256d239-09e9-45c0-997e-68a1f5fdf113" returned: 0 in 1.167s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Lock "cinder-quobyte-a256d239-09e9-45c0-997e-68a1f5fdf113" released by "delete_volume" :: held 2.364s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Created reservations ['ac44cd3a-dafb-426f-aea9-cced45e3b15c', '3d7f1dde-25c3-4aba-a8e7-8acf3000a8bb', '4cf4429e-ad8e-4a65-9ad8-6ea65bbfbfb6', '5d8c8a05-ddcc-42a2-9234-3fd5ffefd949'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:50 devstack sudo[99569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:59:50 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:51 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397" returned: 0 in 1.230s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:51 devstack sudo[99574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397
Jul 03 12:59:51 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:51 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-114fb144-bfd0-4257-badf-be39f96b7c07 req-5a5878ea-a20b-4ddc-924f-0def35feb8da tempest-TestStampPattern-1506570535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" returned: 0 in 1.421s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-114fb144-bfd0-4257-badf-be39f96b7c07 req-5a5878ea-a20b-4ddc-924f-0def35feb8da tempest-TestStampPattern-1506570535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.444s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-114fb144-bfd0-4257-badf-be39f96b7c07 req-5a5878ea-a20b-4ddc-924f-0def35feb8da tempest-TestStampPattern-1506570535 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ad8a348-bd2d-46d3-8c05-54a108f1018d', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:59:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-114fb144-bfd0-4257-badf-be39f96b7c07 req-5a5878ea-a20b-4ddc-924f-0def35feb8da tempest-TestStampPattern-1506570535 None] attachment_update completed successfully.
Jul 03 12:59:51 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.870s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:51 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:59:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Deleted volume successfully.
Jul 03 12:59:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6b320beb-8f87-4751-8bce-b3b71dd26dad tempest-VolumesActionsTest-384004545 None] Lock "cinder-a256d239-09e9-45c0-997e-68a1f5fdf113-delete_volume" released by "delete_volume" :: held 3.660s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:52 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a969486-ab5a-4443-ba19-9a7fcd21a397" returned: 0 in 0.879s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Lock "cinder-quobyte-9a969486-ab5a-4443-ba19-9a7fcd21a397" released by "delete_volume" :: held 2.177s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:52 devstack cinder-volume[86763]: DEBUG cinder.quota [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Created reservations ['af5b084b-4398-4e42-8f8a-6d294f115f30', '4aedf206-a576-437e-9200-80d35355bf0f', '7987a09a-3ee6-4244-b24e-61601fc958d3', '33570e36-38fd-4de5-a967-88a032386797'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:52 devstack sudo[99581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 12:59:52 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:53 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.979s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:53 devstack cinder-volume[86763]: DEBUG cinder.manager [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 12:59:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Deleted volume successfully.
Jul 03 12:59:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-538fd19a-9004-45d9-bf1e-8a685e102354 req-906c5e74-d79a-46e7-a4d5-53a9a59d6a91 tempest-VolumesGetTestJSON-716532953 None] Lock "cinder-9a969486-ab5a-4443-ba19-9a7fcd21a397-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-9b39f6a1-56b6-48d5-aff4-64a18085172e req-1807e8d2-126c-4550-8531-0fef59fa1c23 tempest-TestStampPattern-1506570535 None] Terminate volume connection completed successfully.
Jul 03 12:59:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-9b39f6a1-56b6-48d5-aff4-64a18085172e req-1807e8d2-126c-4550-8531-0fef59fa1c23 tempest-TestStampPattern-1506570535 None] Deleting attachment 6ad8a348-bd2d-46d3-8c05-54a108f1018d. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:59:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-50854df6-4c64-4187-a4dd-8cbec413a7f8 tempest-GroupsV314Test-1078554112 None] Group tempest-GroupsV314Test-Group-1419196549: creating
Jul 03 12:59:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-50854df6-4c64-4187-a4dd-8cbec413a7f8 tempest-GroupsV314Test-1078554112 None] Group tempest-GroupsV314Test-Group-1419196549: created successfully
Jul 03 12:59:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-50854df6-4c64-4187-a4dd-8cbec413a7f8 tempest-GroupsV314Test-1078554112 None] Create group completed successfully.
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Flow 'volume_create_manager' (536e62c7-8a2d-479f-b04e-e372abf88135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5423ae1c-3435-46dd-b4b0-aec194196250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5423ae1c-3435-46dd-b4b0-aec194196250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003221051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=109aa0b9-a75a-46fa-8171-dbe1efbaaa63,host='devstack@QuobyteHD#QuobyteHD',id=c5e01543-1adb-4be0-b9d0-4a852075e367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717a6989dd514b8ba8e5f630acb3335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:01Z,use_quota=True,user_id='939980a0e8be49958bfcc5a6d3613552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13a2bd33-ec29-490c-9eaf-56a5a3efc3b3),volume_type_id=13a2bd33-ec29-490c-9eaf-56a5a3efc3b3)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b32616-dae2-4706-8ec9-ac421c3c32c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b32616-dae2-4706-8ec9-ac421c3c32c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f452799-f38e-4d47-b071-26c98929e8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f452799-f38e-4d47-b071-26c98929e8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e01543-1adb-4be0-b9d0-4a852075e367', 'volume_name': 'volume-c5e01543-1adb-4be0-b9d0-4a852075e367', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94758ed-87ed-4995-887b-b04836e1617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94758ed-87ed-4995-887b-b04836e1617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b80c1a-99f8-4f2b-a523-b167c7c3219d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Volume c5e01543-1adb-4be0-b9d0-4a852075e367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e01543-1adb-4be0-b9d0-4a852075e367', 'volume_size': 1}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=109aa0b9-a75a-46fa-8171-dbe1efbaaa63,created_at=2026-07-03T11:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003221051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=109aa0b9-a75a-46fa-8171-dbe1efbaaa63,host='devstack@QuobyteHD#QuobyteHD',id=c5e01543-1adb-4be0-b9d0-4a852075e367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717a6989dd514b8ba8e5f630acb3335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:01Z,use_quota=True,user_id='939980a0e8be49958bfcc5a6d3613552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13a2bd33-ec29-490c-9eaf-56a5a3efc3b3),volume_type_id=13a2bd33-ec29-490c-9eaf-56a5a3efc3b3)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Creating volume c5e01543-1adb-4be0-b9d0-4a852075e367 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:00:01 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:00:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:01 devstack sudo[99672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 1073741824
Jul 03 13:00:01 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:03 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 1073741824" returned: 0 in 1.520s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:03 devstack sudo[99680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367
Jul 03 13:00:03 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:04 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367" returned: 0 in 1.525s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] <== create_volume: return (3113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:00:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.119s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b80c1a-99f8-4f2b-a523-b167c7c3219d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e01543-1adb-4be0-b9d0-4a852075e367', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c588844b-c0d9-451c-a1e0-711ec2ee876f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Volume volume-c5e01543-1adb-4be0-b9d0-4a852075e367 (c5e01543-1adb-4be0-b9d0-4a852075e367): created successfully
Jul 03 13:00:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c588844b-c0d9-451c-a1e0-711ec2ee876f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Flow 'volume_create_manager' (536e62c7-8a2d-479f-b04e-e372abf88135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f2270631-094a-41bb-92f5-d4e6f6ed7c93 tempest-GroupsV314Test-1078554112 None] Created volume successfully.
Jul 03 13:00:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:00:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:05 devstack sudo[99726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:00:05 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.168s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:06 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:00:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:06 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Cloning volume c5e01543-1adb-4be0-b9d0-4a852075e367 to volume 41e150aa-7a45-4c4a-9960-ce4c3bcb43af
Jul 03 13:00:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Creating offline snapshot e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 of volume c5e01543-1adb-4be0-b9d0-4a852075e367 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:00:06 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dc5d66-3d6c-4eb5-87af-d1543ad2a30a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:07 devstack sudo[99733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367
Jul 03 13:00:07 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:08 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367" returned: 0 in 1.341s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:08 devstack sudo[99772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 1G
Jul 03 13:00:08 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:10 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 1G" returned: 0 in 2.117s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e01543-1adb-4be0-b9d0-4a852075e367 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:10 devstack sudo[99845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e01543-1adb-4be0-b9d0-4a852075e367 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83
Jul 03 13:00:10 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Acquiring lock "cinder-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Lock "cinder-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Acquiring lock "cinder-quobyte-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf52b3b-d01e-41da-aea7-77885b6c1e32]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:11 devstack sudo[99847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6
Jul 03 13:00:11 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:11 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e01543-1adb-4be0-b9d0-4a852075e367 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83" returned: 0 in 1.263s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:11 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:00:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:11 devstack sudo[99855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83
Jul 03 13:00:11 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:12 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" returned: 0 in 1.813s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:00:12 devstack sudo[99862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6
Jul 03 13:00:12 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Flow 'volume_create_manager' (f9ef2121-aec5-4791-8a69-416b071f07b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0352af36-4622-4374-9c2f-65fc94b9883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0352af36-4622-4374-9c2f-65fc94b9883a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-747480965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c11c842-500b-4554-a449-fdb5c817cd19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7aa53da3bd42b4b52483bb39d36226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:13Z,use_quota=True,user_id='8e408a0719894cdcb1f6148de3b28752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9081b06-53a6-4ed7-b720-f5173ecf968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9081b06-53a6-4ed7-b720-f5173ecf968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a47990-7ec8-42bf-ae04-08c57229b3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a47990-7ec8-42bf-ae04-08c57229b3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c11c842-500b-4554-a449-fdb5c817cd19', 'volume_name': 'volume-3c11c842-500b-4554-a449-fdb5c817cd19', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:12 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937fd20c-bcdd-4e6a-a801-0f9d519b5217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937fd20c-bcdd-4e6a-a801-0f9d519b5217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd85369-cfdc-4d35-b586-d430812ab370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:12 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Volume 3c11c842-500b-4554-a449-fdb5c817cd19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c11c842-500b-4554-a449-fdb5c817cd19', 'volume_size': 1}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83" returned: 0 in 1.169s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:12 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.info
Jul 03 13:00:12 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:13 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" returned: 0 in 1.234s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6" released by "delete_volume" :: held 3.116s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:13 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.info" returned: 0 in 0.973s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:13 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:00:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:13 devstack sudo[99868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.info
Jul 03 13:00:13 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:13 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Created reservations ['cf3bfc1c-d55c-4062-a0f5-8f9315f2ff1c', '757870f7-226a-4dd0-8688-df2c6975d540', '91aacc6c-03c2-4685-a6e9-986f194c1606', 'bdee358c-fd13-4606-a272-987263e56c6e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:14 devstack sudo[99870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:00:14 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Acquiring lock "cinder-d32d7331-bf88-44e2-af71-b0a595f09196-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Lock "cinder-d32d7331-bf88-44e2-af71-b0a595f09196-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Acquiring lock "cinder-quobyte-83ab4e71-61a0-48f2-b00b-62dead99e642" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-83ab4e71-61a0-48f2-b00b-62dead99e642" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Acquiring lock "cinder-quobyte-d32d7331-bf88-44e2-af71-b0a595f09196" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-d32d7331-bf88-44e2-af71-b0a595f09196" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Deleting offline snapshot d32d7331-bf88-44e2-af71-b0a595f09196 of volume 83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:00:15 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] snapshot_file for this snap is: volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.info" returned: 0 in 1.219s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Acquiring lock "cinder-quobyte-41e150aa-7a45-4c4a-9960-ce4c3bcb43af" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c2760c-f01e-439d-bc64-57f0e4b31529]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Lock "cinder-quobyte-41e150aa-7a45-4c4a-9960-ce4c3bcb43af" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] snapshot: e699e9b1-00d6-49ea-aeab-0ee3ffabdf83, volume: 41e150aa-7a45-4c4a-9960-ce4c3bcb43af,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f7b568-89af-40cf-8e1a-95a1becc03c9]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:15 devstack sudo[99873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196
Jul 03 13:00:15 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:15 devstack sudo[99874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83
Jul 03 13:00:15 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:15 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.422s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:00:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Deleted volume successfully.
Jul 03 13:00:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7864e313-e81d-4f5c-84e7-6c6ae74ea0b3 tempest-TestStampPattern-1506570535 None] Lock "cinder-a9cad2a1-ab6f-4a85-8ed7-cdf73e94cef6-delete_volume" released by "delete_volume" :: held 4.938s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:16 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:16 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83" returned: 0 in 0.963s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5e01543-1adb-4be0-b9d0-4a852075e367(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:00:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:00:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:00:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196" returned: 0 in 1.065s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83ab4e71-61a0-48f2-b00b-62dead99e642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:00:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bfcb40-be54-4356-a25d-fce400a903c9]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a2d269-3d56-45c5-a957-06e5b64f105e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:16 devstack sudo[99884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367
Jul 03 13:00:16 devstack sudo[99885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642
Jul 03 13:00:16 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:16 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:17 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367" returned: 0 in 0.921s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:17 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 13:00:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:17 devstack sudo[99895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af
Jul 03 13:00:17 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:17 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642" returned: 0 in 1.006s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:17 devstack sudo[99897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196
Jul 03 13:00:17 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:18 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196" returned: 0 in 0.878s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:18 devstack sudo[99913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196
Jul 03 13:00:18 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:20 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642.d32d7331-bf88-44e2-af71-b0a595f09196" returned: 0 in 2.780s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-d32d7331-bf88-44e2-af71-b0a595f09196" released by "_delete_snapshot" :: held 5.990s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-83ab4e71-61a0-48f2-b00b-62dead99e642" released by "delete_snapshot" :: held 6.047s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Created reservations ['66160488-b998-4207-aa1b-6bf457b5665c', '8765d07e-331b-4919-9825-84543b9c2611', '1a0e1bd4-aadd-4c15-89e0-1f2e2a13f6fc', '4bf45a93-a69a-4fca-b13c-7f67524575fa'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Delete snapshot completed successfully.
Jul 03 13:00:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5a61ef16-e1f1-4cd3-bc8a-f9982d5e07e4 tempest-TestStampPattern-1506570535 None] Lock "cinder-d32d7331-bf88-44e2-af71-b0a595f09196-delete_snapshot" released by "delete_snapshot" :: held 6.819s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:25 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af" returned: 0 in 8.375s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a97253-14dd-415a-904e-e0bf0ccde35b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:25 devstack sudo[99933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367
Jul 03 13:00:25 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:26 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367" returned: 0 in 1.250s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:26 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367, size 1024.00 MB, duration 8.38 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:00:26 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Converted 1024.00 MB image at 122.26 MB/s
Jul 03 13:00:26 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:00:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:26 devstack sudo[99938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af
Jul 03 13:00:26 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:28 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af" returned: 0 in 1.372s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Lock "cinder-quobyte-41e150aa-7a45-4c4a-9960-ce4c3bcb43af" released by "_copy_volume_from_snapshot" :: held 13.014s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:28 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=85,cinder:SELECT=79,cinder:INSERT=21,cinder:DELETE=4 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:00:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Acquiring lock "cinder-quobyte-e699e9b1-00d6-49ea-aeab-0ee3ffabdf83" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Lock "cinder-quobyte-e699e9b1-00d6-49ea-aeab-0ee3ffabdf83" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Deleting offline snapshot e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 of volume c5e01543-1adb-4be0-b9d0-4a852075e367 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:00:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] snapshot_file for this snap is: volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:00:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5de00b2-7a21-43bd-8346-f6a2659e0234]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:28 devstack sudo[100024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83
Jul 03 13:00:28 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:29 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83" returned: 0 in 0.996s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5e01543-1adb-4be0-b9d0-4a852075e367(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:00:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7547078d-ed10-40bb-8117-429b25c3caa7]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:29 devstack sudo[100034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367
Jul 03 13:00:29 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:30 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367" returned: 0 in 0.989s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:30 devstack sudo[100042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83
Jul 03 13:00:30 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:31 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83" returned: 0 in 0.878s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:31 devstack sudo[100048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83
Jul 03 13:00:31 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:31 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=93,cinder:SELECT=65,cinder:INSERT=19,cinder:DELETE=10 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:00:32 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367.e699e9b1-00d6-49ea-aeab-0ee3ffabdf83" returned: 0 in 0.806s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Lock "cinder-quobyte-e699e9b1-00d6-49ea-aeab-0ee3ffabdf83" released by "_delete_snapshot" :: held 3.822s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.203s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.243s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-747480965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c11c842-500b-4554-a449-fdb5c817cd19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7aa53da3bd42b4b52483bb39d36226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:13Z,use_quota=True,user_id='8e408a0719894cdcb1f6148de3b28752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Creating volume 3c11c842-500b-4554-a449-fdb5c817cd19 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:00:32 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:00:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:32 devstack sudo[100051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19 1073741824
Jul 03 13:00:32 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cc4ec293-a6b1-43a0-9c55-ca1506a2ee68 tempest-GroupsV314Test-1078554112 None] Create group from source-group-109aa0b9-a75a-46fa-8171-dbe1efbaaa63 completed successfully.
Jul 03 13:00:33 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19 1073741824" returned: 0 in 1.162s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:33 devstack sudo[100057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19
Jul 03 13:00:33 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Acquiring lock "cinder-quobyte-41e150aa-7a45-4c4a-9960-ce4c3bcb43af" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Lock "cinder-quobyte-41e150aa-7a45-4c4a-9960-ce4c3bcb43af" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dde1b2-90ec-448b-96be-8b4179e1a390]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Acquiring lock "cinder-83ab4e71-61a0-48f2-b00b-62dead99e642-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Lock "cinder-83ab4e71-61a0-48f2-b00b-62dead99e642-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:33 devstack sudo[100059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af
Jul 03 13:00:33 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Acquiring lock "cinder-quobyte-83ab4e71-61a0-48f2-b00b-62dead99e642" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-83ab4e71-61a0-48f2-b00b-62dead99e642" acquired by "delete_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1753c8fb-8659-423f-9f53-ee51068e1031]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:34 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19" returned: 0 in 0.928s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.166s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:34 devstack sudo[100061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642
Jul 03 13:00:34 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd85369-cfdc-4d35-b586-d430812ab370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c11c842-500b-4554-a449-fdb5c817cd19', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d973ba-625a-4d12-bbc6-28ac148d47d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Volume volume-3c11c842-500b-4554-a449-fdb5c817cd19 (3c11c842-500b-4554-a449-fdb5c817cd19): created successfully
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d973ba-625a-4d12-bbc6-28ac148d47d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Flow 'volume_create_manager' (f9ef2121-aec5-4791-8a69-416b071f07b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6fedc305-73ac-437e-b4d7-27baa03d4bd9 tempest-VolumesListAdminTestJSON-992959980 None] Created volume successfully.
Jul 03 13:00:34 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af" returned: 0 in 1.105s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:34 devstack sudo[100067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af
Jul 03 13:00:34 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:35 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642" returned: 0 in 1.240s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:35 devstack sudo[100072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642
Jul 03 13:00:35 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Flow 'volume_create_manager' (fda8fc7a-5863-47a5-a653-1b2eaa1320ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f91b2f7-e58a-4969-8927-cb659cca662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f91b2f7-e58a-4969-8927-cb659cca662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-439131638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94ca6fb-d5c6-4c63-a7a9-897f753800ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7aa53da3bd42b4b52483bb39d36226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:35Z,use_quota=True,user_id='8e408a0719894cdcb1f6148de3b28752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373caab1-649e-4384-a74c-c4fe2a3d7603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373caab1-649e-4384-a74c-c4fe2a3d7603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d600662f-6718-48fc-a8cd-2463fa12a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d600662f-6718-48fc-a8cd-2463fa12a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f94ca6fb-d5c6-4c63-a7a9-897f753800ab', 'volume_name': 'volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa4f470-ff58-49fb-9c9c-e64724d45c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa4f470-ff58-49fb-9c9c-e64724d45c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718edcde-535a-440d-a89c-2417571f1b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Volume f94ca6fb-d5c6-4c63-a7a9-897f753800ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab', 'volume_size': 1}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-439131638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94ca6fb-d5c6-4c63-a7a9-897f753800ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7aa53da3bd42b4b52483bb39d36226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:35Z,use_quota=True,user_id='8e408a0719894cdcb1f6148de3b28752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Creating volume f94ca6fb-d5c6-4c63-a7a9-897f753800ab {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:00:35 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:35 devstack sudo[100075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab 1073741824
Jul 03 13:00:35 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:35 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41e150aa-7a45-4c4a-9960-ce4c3bcb43af" returned: 0 in 0.981s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Lock "cinder-quobyte-41e150aa-7a45-4c4a-9960-ce4c3bcb43af" released by "delete_volume" :: held 2.179s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Created reservations ['e83b7bca-0b8a-44e1-bc0b-0d09f85bbacb'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:35 devstack cinder-volume[86763]: WARNING cinder.quota [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2106588412 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2106588412, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:00:35 devstack cinder-volume[86763]: WARNING cinder.quota [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2106588412 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2106588412, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Created reservations ['534919b0-2b11-482d-9120-74d3d73ddd71', '263f63db-359c-42dd-aa9f-06e305a8a372', 'b63af44a-676b-4f9a-ba15-dfe8839be451', '6bca4fe4-adfa-4fab-9ecd-13b6d6cf45fe'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:36 devstack sudo[100078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:00:36 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:36 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-83ab4e71-61a0-48f2-b00b-62dead99e642" returned: 0 in 1.039s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Lock "cinder-quobyte-83ab4e71-61a0-48f2-b00b-62dead99e642" released by "delete_volume" :: held 2.398s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Created reservations ['67fe5f21-11c3-46ea-879c-b4342a35a6d0', 'e9f773e9-16a8-456e-b4d4-56ea797bb8d7', '13a66bc9-0be6-48be-b531-7c00d485b37b', '3a9f9e08-62df-46c8-9fcf-c450edc1dac7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:36 devstack sudo[100083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:00:36 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:36 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab 1073741824" returned: 0 in 1.275s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:37 devstack sudo[100086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab
Jul 03 13:00:37 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:37 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.842s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:00:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f21644da-e454-4f49-a432-0e2735832399 tempest-GroupsV314Test-1078554112 None] Delete group completed successfully.
Jul 03 13:00:37 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.945s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:00:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Deleted volume successfully.
Jul 03 13:00:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a5546266-e6db-4550-a8e0-41084bd3cf2f tempest-TestStampPattern-1506570535 None] Lock "cinder-83ab4e71-61a0-48f2-b00b-62dead99e642-delete_volume" released by "delete_volume" :: held 3.749s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Acquiring lock "cinder-quobyte-c5e01543-1adb-4be0-b9d0-4a852075e367" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Lock "cinder-quobyte-c5e01543-1adb-4be0-b9d0-4a852075e367" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[109a3345-6302-40fb-a39d-241e3f752381]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:38 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab" returned: 0 in 1.099s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] <== create_volume: return (2442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:00:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.446s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718edcde-535a-440d-a89c-2417571f1b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51be8faf-5388-4015-8c31-cc20ebc10717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:38 devstack sudo[100090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367
Jul 03 13:00:38 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Volume volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab (f94ca6fb-d5c6-4c63-a7a9-897f753800ab): created successfully
Jul 03 13:00:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51be8faf-5388-4015-8c31-cc20ebc10717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Flow 'volume_create_manager' (fda8fc7a-5863-47a5-a653-1b2eaa1320ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1d83c764-8969-4462-a9a4-2a1dec8d0dd0 tempest-VolumesListAdminTestJSON-992959980 None] Created volume successfully.
Jul 03 13:00:39 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367" returned: 0 in 1.060s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:39 devstack sudo[100095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367
Jul 03 13:00:39 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Flow 'volume_create_manager' (50c20ffe-624f-41e8-9541-5013476be205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bedb99-e0b7-4c75-8519-cf9d7b7e361b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bedb99-e0b7-4c75-8519-cf9d7b7e361b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1330776917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7795a680-4230-478c-966b-a03a98a82ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7aa53da3bd42b4b52483bb39d36226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:39Z,use_quota=True,user_id='8e408a0719894cdcb1f6148de3b28752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1674442a-c2f0-47ce-801e-74de3a6a6909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1674442a-c2f0-47ce-801e-74de3a6a6909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279eb668-8470-43a3-aecf-c9daf2d8001b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279eb668-8470-43a3-aecf-c9daf2d8001b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7795a680-4230-478c-966b-a03a98a82ed0', 'volume_name': 'volume-7795a680-4230-478c-966b-a03a98a82ed0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e22d42-f831-4514-9139-e8d2fdd99ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e22d42-f831-4514-9139-e8d2fdd99ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98983401-e20d-470a-864b-de6a6a4ea7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:39 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Volume 7795a680-4230-478c-966b-a03a98a82ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7795a680-4230-478c-966b-a03a98a82ed0', 'volume_size': 1}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1330776917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7795a680-4230-478c-966b-a03a98a82ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7aa53da3bd42b4b52483bb39d36226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:39Z,use_quota=True,user_id='8e408a0719894cdcb1f6148de3b28752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Creating volume 7795a680-4230-478c-966b-a03a98a82ed0 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:00:39 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:00:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:39 devstack sudo[100097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0 1073741824
Jul 03 13:00:39 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:40 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5e01543-1adb-4be0-b9d0-4a852075e367" returned: 0 in 0.950s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Lock "cinder-quobyte-c5e01543-1adb-4be0-b9d0-4a852075e367" released by "delete_volume" :: held 2.119s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Created reservations ['99a018b9-ed03-43b9-b680-b6416e1b1328'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Created reservations ['e0e62217-9660-45dc-a731-bdd8dea7a385', 'ee0c1106-49b4-4464-b2ff-7c10bc3d47a0', '3ef2d668-3786-4eb0-9249-3b765d06e04e', 'b734c974-069f-43e8-a0cb-d8d55443aefc'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:40 devstack sudo[100105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:00:40 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:40 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0 1073741824" returned: 0 in 1.094s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:40 devstack sudo[100108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0
Jul 03 13:00:40 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:41 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.016s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:41 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:00:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-771f3c68-ef7f-44ff-8f51-c8dfb59caf6e tempest-GroupsV314Test-1078554112 None] Delete group completed successfully.
Jul 03 13:00:41 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0" returned: 0 in 0.959s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:00:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98983401-e20d-470a-864b-de6a6a4ea7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7795a680-4230-478c-966b-a03a98a82ed0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cb9750-c0b2-4bc8-851f-718e0505b648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:41 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Volume volume-7795a680-4230-478c-966b-a03a98a82ed0 (7795a680-4230-478c-966b-a03a98a82ed0): created successfully
Jul 03 13:00:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cb9750-c0b2-4bc8-851f-718e0505b648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Flow 'volume_create_manager' (50c20ffe-624f-41e8-9541-5013476be205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-15076343-f34b-40e1-b1b1-b79334a3545f tempest-VolumesListAdminTestJSON-992959980 None] Created volume successfully.
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Flow 'volume_create_manager' (55002e23-8f45-4fc2-9bab-644a88a408a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353be379-f51a-408b-a353-1e21db8cee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353be379-f51a-408b-a353-1e21db8cee8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f71f0df-dc4f-4811-9c09-50c9e0865134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9691b01e63488aac4f5dbf8561110b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:44Z,use_quota=True,user_id='fc158953d96846038f19ae4ad7d2a800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d6fc97-0ffe-4f1a-80a1-619dbcfcc4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d6fc97-0ffe-4f1a-80a1-619dbcfcc4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481eed1c-13b9-4ecc-be02-f933df141bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481eed1c-13b9-4ecc-be02-f933df141bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f71f0df-dc4f-4811-9c09-50c9e0865134', 'volume_name': 'volume-2f71f0df-dc4f-4811-9c09-50c9e0865134', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f3b1f1-94a5-4c59-8cac-aa6053b7fce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f3b1f1-94a5-4c59-8cac-aa6053b7fce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e021cd8-73f4-41a0-b2a4-2a45b1352ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Volume 2f71f0df-dc4f-4811-9c09-50c9e0865134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f71f0df-dc4f-4811-9c09-50c9e0865134', 'volume_size': 1}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f71f0df-dc4f-4811-9c09-50c9e0865134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9691b01e63488aac4f5dbf8561110b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:44Z,use_quota=True,user_id='fc158953d96846038f19ae4ad7d2a800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Creating volume 2f71f0df-dc4f-4811-9c09-50c9e0865134 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:00:44 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:00:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:44 devstack sudo[100121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134 1073741824
Jul 03 13:00:44 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:45 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134 1073741824" returned: 0 in 1.238s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:45 devstack sudo[100127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134
Jul 03 13:00:45 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:46 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134" returned: 0 in 0.870s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:00:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.176s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e021cd8-73f4-41a0-b2a4-2a45b1352ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f71f0df-dc4f-4811-9c09-50c9e0865134', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010109a2-fb24-49aa-89bc-ebf1dddacbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Volume volume-2f71f0df-dc4f-4811-9c09-50c9e0865134 (2f71f0df-dc4f-4811-9c09-50c9e0865134): created successfully
Jul 03 13:00:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010109a2-fb24-49aa-89bc-ebf1dddacbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Flow 'volume_create_manager' (55002e23-8f45-4fc2-9bab-644a88a408a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5ad7ee37-d294-4d0e-a728-5b23a87b479f tempest-VolumesListAdminTestJSON-893068098 None] Created volume successfully.
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Acquiring lock "cinder-2f71f0df-dc4f-4811-9c09-50c9e0865134-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Lock "cinder-2f71f0df-dc4f-4811-9c09-50c9e0865134-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Acquiring lock "cinder-quobyte-2f71f0df-dc4f-4811-9c09-50c9e0865134" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Lock "cinder-quobyte-2f71f0df-dc4f-4811-9c09-50c9e0865134" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12a5f2b-a0c6-42e4-b800-17251361ff55]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "cinder-7795a680-4230-478c-966b-a03a98a82ed0-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-7795a680-4230-478c-966b-a03a98a82ed0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "cinder-quobyte-7795a680-4230-478c-966b-a03a98a82ed0" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-quobyte-7795a680-4230-478c-966b-a03a98a82ed0" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c0b901-4654-410f-8005-7136418d959e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:47 devstack sudo[100131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134
Jul 03 13:00:47 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:47 devstack sudo[100132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0
Jul 03 13:00:47 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6c57778c-cdb8-4612-8f9d-23b39c38f927 tempest-GroupsV320Test-1152179365 None] Group tempest-GroupsV320Test-Group-1283590695: creating
Jul 03 13:00:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6c57778c-cdb8-4612-8f9d-23b39c38f927 tempest-GroupsV320Test-1152179365 None] Group tempest-GroupsV320Test-Group-1283590695: created successfully
Jul 03 13:00:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6c57778c-cdb8-4612-8f9d-23b39c38f927 tempest-GroupsV320Test-1152179365 None] Create group completed successfully.
Jul 03 13:00:49 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134" returned: 0 in 1.413s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:49 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134
Jul 03 13:00:49 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:49 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0" returned: 0 in 1.378s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:49 devstack sudo[100149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0
Jul 03 13:00:49 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:50 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2f71f0df-dc4f-4811-9c09-50c9e0865134" returned: 0 in 1.548s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Lock "cinder-quobyte-2f71f0df-dc4f-4811-9c09-50c9e0865134" released by "delete_volume" :: held 3.047s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:50 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7795a680-4230-478c-966b-a03a98a82ed0" returned: 0 in 1.551s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:50 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Created reservations ['c079cf54-ca50-4cf5-9614-c2f9578c832c', 'e03df561-85da-4f2c-9240-cf0fb77cf01d', '418eb3ab-8465-4017-bbc2-7a1b7298225a', '81d15698-7540-4bb2-8689-2751bddbcf55'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-quobyte-7795a680-4230-478c-966b-a03a98a82ed0" released by "delete_volume" :: held 3.008s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:50 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e6ebabd4-19e9-4254-81e9-dacc11805673 tempest-GroupsV320Test-1152179365 None] Created reservations ['70b91e28-87a3-47a3-b801-9bd6310569d2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6ebabd4-19e9-4254-81e9-dacc11805673 tempest-GroupsV320Test-1152179365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6ebabd4-19e9-4254-81e9-dacc11805673 tempest-GroupsV320Test-1152179365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e6ebabd4-19e9-4254-81e9-dacc11805673 tempest-GroupsV320Test-1152179365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e6ebabd4-19e9-4254-81e9-dacc11805673 tempest-GroupsV320Test-1152179365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6ebabd4-19e9-4254-81e9-dacc11805673 tempest-GroupsV320Test-1152179365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6ebabd4-19e9-4254-81e9-dacc11805673 tempest-GroupsV320Test-1152179365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:51 devstack sudo[100156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:00:51 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:51 devstack sudo[100158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:00:51 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Created reservations ['01a6a5a8-427e-4a4d-b251-d07afc667bae', '4482fdc3-9a6f-48cc-9243-14498ba2bad7', 'bb09af5d-d5e2-46f5-9dae-ae3d7723610e', '4b0e2553-94ba-472b-8b10-ab38acc784e2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:51 devstack sudo[100160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:00:51 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:52 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6ebabd4-19e9-4254-81e9-dacc11805673 tempest-GroupsV320Test-1152179365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.127s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e6ebabd4-19e9-4254-81e9-dacc11805673 tempest-GroupsV320Test-1152179365 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:00:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e6ebabd4-19e9-4254-81e9-dacc11805673 tempest-GroupsV320Test-1152179365 None] Delete group completed successfully.
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "cinder-f94ca6fb-d5c6-4c63-a7a9-897f753800ab-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-f94ca6fb-d5c6-4c63-a7a9-897f753800ab-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "cinder-quobyte-f94ca6fb-d5c6-4c63-a7a9-897f753800ab" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-quobyte-f94ca6fb-d5c6-4c63-a7a9-897f753800ab" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:52 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.473s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:00:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Deleted volume successfully.
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d559f0-b515-47fe-9f7c-e24ee6bb3693]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-aab37328-1114-4ab9-8347-be9b9547983a tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-7795a680-4230-478c-966b-a03a98a82ed0-delete_volume" released by "delete_volume" :: held 5.102s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:52 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.892s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:00:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Deleted volume successfully.
Jul 03 13:00:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2a00c267-e04a-48c2-9af7-6298f3ef7ff4 tempest-VolumesListAdminTestJSON-893068098 None] Lock "cinder-2f71f0df-dc4f-4811-9c09-50c9e0865134-delete_volume" released by "delete_volume" :: held 5.469s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:53 devstack sudo[100165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab
Jul 03 13:00:53 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab" returned: 0 in 1.230s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:54 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:54 devstack sudo[100173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab
Jul 03 13:00:54 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-b3086510-b327-4da6-ba33-a923c5363b25 req-3180a995-6ab2-44cf-bf00-2a71b2659483 tempest-TestMinimumBasicScenario-1292755471 None] Terminate volume connection completed successfully.
Jul 03 13:00:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-b3086510-b327-4da6-ba33-a923c5363b25 req-3180a995-6ab2-44cf-bf00-2a71b2659483 tempest-TestMinimumBasicScenario-1292755471 None] Deleting attachment f17cec66-9d3b-4132-83d0-c36fd5e065b8. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:00:55 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f94ca6fb-d5c6-4c63-a7a9-897f753800ab" returned: 0 in 1.174s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-quobyte-f94ca6fb-d5c6-4c63-a7a9-897f753800ab" released by "delete_volume" :: held 2.494s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:55 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Created reservations ['8fc57a92-535a-4ec4-94ed-a8bb370ac091', '6119ba63-bb1e-482b-8721-9a4d1ba95496', '7ef57f21-e22f-4515-9a06-174dd40d81d9', '5437968d-9440-4686-b928-6e1edffad127'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:55 devstack sudo[100215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:00:55 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "cinder-3c11c842-500b-4554-a449-fdb5c817cd19-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-3c11c842-500b-4554-a449-fdb5c817cd19-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "cinder-quobyte-3c11c842-500b-4554-a449-fdb5c817cd19" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-quobyte-3c11c842-500b-4554-a449-fdb5c817cd19" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:56 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[195a929a-16e8-45a6-b696-1884bf8c6851]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:56 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.116s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:56 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:00:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Deleted volume successfully.
Jul 03 13:00:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e132e362-b092-4d93-8c4f-41109d8a7adc tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-f94ca6fb-d5c6-4c63-a7a9-897f753800ab-delete_volume" released by "delete_volume" :: held 4.004s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:56 devstack sudo[100218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19
Jul 03 13:00:56 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Acquiring lock "cinder-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Lock "cinder-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Acquiring lock "cinder-quobyte-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Lock "cinder-quobyte-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b49c743-6027-4f66-aa87-854b0fc346fb]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:57 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19" returned: 0 in 1.139s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:57 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19
Jul 03 13:00:57 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:57 devstack sudo[100224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58
Jul 03 13:00:57 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:58 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3c11c842-500b-4554-a449-fdb5c817cd19" returned: 0 in 0.987s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-quobyte-3c11c842-500b-4554-a449-fdb5c817cd19" released by "delete_volume" :: held 2.189s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:58 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Created reservations ['b322de3e-469c-4ba9-a55f-473a7977463d', 'f67baf91-a303-4c49-9d26-567ba20499ab', '109fc3df-2670-4e95-9e24-5c0b2f4ebc16', '122e585a-e09c-48da-87b6-bdbaeeb78d9a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:58 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58" returned: 0 in 1.278s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:58 devstack sudo[100233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58
Jul 03 13:00:58 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:58 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:00:58 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:59 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.982s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:59 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:00:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Deleted volume successfully.
Jul 03 13:00:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74b04d44-5dce-4d96-b3f8-9d912052b44b tempest-VolumesListAdminTestJSON-992959980 None] Lock "cinder-3c11c842-500b-4554-a449-fdb5c817cd19-delete_volume" released by "delete_volume" :: held 3.578s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:00 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58" returned: 0 in 1.192s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Lock "cinder-quobyte-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58" released by "delete_volume" :: held 2.543s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Created reservations ['0b54a833-46dd-41d6-a74e-08f159f7c78c', '1b2accb9-09cf-4525-ba75-2856bc3d3a1c', 'a13efe41-9550-40a4-8429-5ebaa474cd84', '78f50c2e-22cc-44e9-9c0b-43a67536aaf9'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:01:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:00 devstack sudo[100240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:01:00 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:00 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Flow 'volume_create_manager' (97452b57-02a1-4e7c-8956-b7dca1d4622b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12f558a-2244-4093-8b00-e91b3010e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12f558a-2244-4093-8b00-e91b3010e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1674119854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad75e32a-6b41-43df-98b4-99da658b18d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c1762d85f24d4ca15e48b64a535487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:01Z,use_quota=True,user_id='63e980b85c444dd49d62d3e112eb76c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5848b381-6e77-489e-84a8-9acf9600fa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5848b381-6e77-489e-84a8-9acf9600fa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9f1705-2b71-434a-a60e-9aa82e3dc641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9f1705-2b71-434a-a60e-9aa82e3dc641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad75e32a-6b41-43df-98b4-99da658b18d1', 'volume_name': 'volume-ad75e32a-6b41-43df-98b4-99da658b18d1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f42b8cc-4381-4e58-9a46-aa535392a395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f42b8cc-4381-4e58-9a46-aa535392a395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ba69c7-454e-4328-9e11-216867c02959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Volume ad75e32a-6b41-43df-98b4-99da658b18d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad75e32a-6b41-43df-98b4-99da658b18d1', 'volume_size': 1}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1674119854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad75e32a-6b41-43df-98b4-99da658b18d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c1762d85f24d4ca15e48b64a535487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:01Z,use_quota=True,user_id='63e980b85c444dd49d62d3e112eb76c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Creating volume ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:01 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:01 devstack sudo[100242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1 1073741824
Jul 03 13:01:01 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:01 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.313s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:01:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Deleted volume successfully.
Jul 03 13:01:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9f654cbd-25f8-4e52-b762-21d43654d4f5 tempest-TestMinimumBasicScenario-1292755471 None] Lock "cinder-e6194f3b-ec5d-44c3-bb94-8e42acc2ad58-delete_volume" released by "delete_volume" :: held 4.222s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:02 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1 1073741824" returned: 0 in 1.434s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:02 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1
Jul 03 13:01:02 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:03 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1" returned: 0 in 1.271s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] <== create_volume: return (2782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:01:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.787s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ba69c7-454e-4328-9e11-216867c02959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad75e32a-6b41-43df-98b4-99da658b18d1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9934c270-8ec1-4b02-be38-4475eb032473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Volume volume-ad75e32a-6b41-43df-98b4-99da658b18d1 (ad75e32a-6b41-43df-98b4-99da658b18d1): created successfully
Jul 03 13:01:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9934c270-8ec1-4b02-be38-4475eb032473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Flow 'volume_create_manager' (97452b57-02a1-4e7c-8956-b7dca1d4622b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a85ffced-4125-4bb6-b66b-a3e8616f9d57 tempest-SnapshotsActionsTest-1990158738 None] Created volume successfully.
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Flow 'volume_create_manager' (f795c36c-65d1-41af-8d06-ffed0ea05ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e885d8e7-8ff5-4234-8239-ba82af5fe424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e885d8e7-8ff5-4234-8239-ba82af5fe424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368f5fa5-136d-46e6-9b15-94e47e26a6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203f30a9926144ffb5b9fd92c2f192b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:05Z,use_quota=True,user_id='eb1c34c63cfb482ab06ed8edefbf02f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eac4a781-935f-4e63-8e33-1c6ff3b93fb7),volume_type_id=eac4a781-935f-4e63-8e33-1c6ff3b93fb7)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af5df5e-7ee4-4d1e-9f22-930b6cf986cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af5df5e-7ee4-4d1e-9f22-930b6cf986cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd971ff-7616-4ff5-bfb0-b001aac9ed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] Creating offline snapshot cb98aadd-d30c-428e-a96f-4c5866356c49 of volume ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[267d64b3-eda3-45de-bd71-b7fa46a3977b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:04 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1
Jul 03 13:01:04 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:05 devstack sudo[100305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:01:05 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd971ff-7616-4ff5-bfb0-b001aac9ed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '368f5fa5-136d-46e6-9b15-94e47e26a6bd', 'volume_name': 'volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd', 'volume_size': 1, 'image_id': '5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c48f27e4d4cb4ade70a9778b3c279a83', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '203f30a9926144ffb5b9fd92c2f192b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34a112d0e219661f391e8c5f5aa11dc06815f8234f34a176c7ab8424cb30868cd6b734bacefd3e0bf2ade7b17e78966cbdcf123e4240e129ba981f6ae356b08e', 'id': '5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'created_at': datetime.datetime(2026, 7, 3, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 1, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ee99fac-79c9-4f4a-bc95-9234fc6f8f95/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b64cf050>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b311426-8cd2-4666-b500-2d7c657c8746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b311426-8cd2-4666-b500-2d7c657c8746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57006854-278e-47a9-9206-d8856e8eee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Volume 368f5fa5-136d-46e6-9b15-94e47e26a6bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd', 'volume_size': 1, 'image_id': '5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c48f27e4d4cb4ade70a9778b3c279a83', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '203f30a9926144ffb5b9fd92c2f192b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34a112d0e219661f391e8c5f5aa11dc06815f8234f34a176c7ab8424cb30868cd6b734bacefd3e0bf2ade7b17e78966cbdcf123e4240e129ba981f6ae356b08e', 'id': '5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'created_at': datetime.datetime(2026, 7, 3, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 1, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ee99fac-79c9-4f4a-bc95-9234fc6f8f95/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b64cf050>}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Trying to clone 368f5fa5-136d-46e6-9b15-94e47e26a6bd from image 5ee99fac-79c9-4f4a-bc95-9234fc6f8f95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jul 03 13:01:05 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c747f3e5-4a85-4873-b62e-7d1fa420b0f9]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:05 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1" returned: 0 in 1.050s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:05 devstack sudo[100311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 1G
Jul 03 13:01:05 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:05 devstack sudo[100310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD
Jul 03 13:01:05 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:06 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.995s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:01:06 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD" returned: 0 in 0.888s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:06 devstack sudo[100321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD
Jul 03 13:01:06 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:06 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 1G" returned: 0 in 1.040s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:06 devstack sudo[100323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:01:06 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Flow 'volume_create_manager' (810141c2-9d2b-415e-ae9e-4ed622860ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57d00ec-4771-4667-b35d-4e3f14f1c883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57d00ec-4771-4667-b35d-4e3f14f1c883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1865093190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c830aeb-544f-4a99-8978-152aaf588cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecaca32352d473c8e8e4bd14cbdbdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:07Z,use_quota=True,user_id='4f8cba47146845a08315549866899098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7a0084-61e6-4fd5-b086-64676f36087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7a0084-61e6-4fd5-b086-64676f36087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f46a221-674e-41a8-add6-02bc03cb640f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:01:07 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD" returned: 1 in 1.013s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Temporary image 5ee99fac-79c9-4f4a-bc95-9234fc6f8f95 is fetched for user eb1c34c63cfb482ab06ed8edefbf02f5. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jul 03 13:01:07 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 0.897s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:07 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 is being set with open permissions: ugo+rw
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:07 devstack sudo[100332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:01:07 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6cab68-bbf3-474d-98c0-a396450feac4]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f46a221-674e-41a8-add6-02bc03cb640f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c830aeb-544f-4a99-8978-152aaf588cd3', 'volume_name': 'volume-4c830aeb-544f-4a99-8978-152aaf588cd3', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b61001a0>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5cced9-6ccd-4ffe-bcd4-0406c1350b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5cced9-6ccd-4ffe-bcd4-0406c1350b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d905da62-37ff-4214-b698-3e4c48509550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Volume 4c830aeb-544f-4a99-8978-152aaf588cd3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c830aeb-544f-4a99-8978-152aaf588cd3', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b61001a0>}
Jul 03 13:01:07 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Trying to clone 4c830aeb-544f-4a99-8978-152aaf588cd3 from image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jul 03 13:01:07 devstack sudo[100334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD
Jul 03 13:01:07 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:08 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jul 03 13:01:08 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 13:01:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffba710-eb3d-4998-98c8-4918a0f831f4]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:08 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 0.952s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:08 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD
Jul 03 13:01:08 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:08 devstack sudo[100340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.info
Jul 03 13:01:08 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:08 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD" returned: 0 in 1.129s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:09 devstack sudo[100344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD
Jul 03 13:01:09 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:09 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD" returned: 0 in 0.909s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:09 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Temporary image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 is fetched for user 4f8cba47146845a08315549866899098. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jul 03 13:01:09 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.info" returned: 0 in 0.738s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:09 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.info is being set with open permissions: ugo+rw
Jul 03 13:01:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:09 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.info
Jul 03 13:01:09 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:09 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48fdfca-b245-4d94-9cec-1119ebc09d6c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:09 devstack sudo[100353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD
Jul 03 13:01:09 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:10 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD" returned: 1 in 1.099s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:10 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.info" returned: 0 in 0.897s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.764s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368f5fa5-136d-46e6-9b15-94e47e26a6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203f30a9926144ffb5b9fd92c2f192b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:05Z,use_quota=True,user_id='eb1c34c63cfb482ab06ed8edefbf02f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eac4a781-935f-4e63-8e33-1c6ff3b93fb7),volume_type_id=eac4a781-935f-4e63-8e33-1c6ff3b93fb7)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Creating volume 368f5fa5-136d-46e6-9b15-94e47e26a6bd {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:10 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:10 devstack sudo[100361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd 1073741824
Jul 03 13:01:10 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1d0d32e3-70b3-4f5e-92cb-0b7d184e8df9 tempest-SnapshotsActionsTest-1990158738 None] Create snapshot completed successfully
Jul 03 13:01:10 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD" returned: 0 in 1.021s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:11 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd 1073741824" returned: 0 in 1.100s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:11 devstack sudo[100371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd
Jul 03 13:01:11 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:12 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd" returned: 0 in 0.821s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.810s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1865093190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c830aeb-544f-4a99-8978-152aaf588cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecaca32352d473c8e8e4bd14cbdbdc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:07Z,use_quota=True,user_id='4f8cba47146845a08315549866899098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Creating volume 4c830aeb-544f-4a99-8978-152aaf588cd3 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:12 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:12 devstack sudo[100374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 1073741824
Jul 03 13:01:12 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Attempting download of 5ee99fac-79c9-4f4a-bc95-9234fc6f8f95 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'metadata': {}}])) to volume 368f5fa5-136d-46e6-9b15-94e47e26a6bd. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed55028e-2586-49a4-af68-58b856fccbdb]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_oqornzp9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:12 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_oqornzp9
Jul 03 13:01:12 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:13 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_oqornzp9" returned: 0 in 1.006s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_oqornzp9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:13 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 1073741824" returned: 0 in 1.166s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:13 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3
Jul 03 13:01:13 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:13 devstack sudo[100384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_oqornzp9
Jul 03 13:01:13 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:14 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_oqornzp9" returned: 1 in 1.024s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_oqornzp9' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c580b6a9-ccce-4710-9031-e51308348ec1]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:14 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3" returned: 0 in 0.985s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.827s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] Creating offline snapshot cdf21695-0aad-4b00-a576-929882083812 of volume ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:01:14 devstack sudo[100392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD
Jul 03 13:01:14 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Attempting download of 8af9b126-5566-44ac-8948-4fb0a1be3fd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}])) to volume 4c830aeb-544f-4a99-8978-152aaf588cd3. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c095bb-7012-43c7-bcf1-201c60122b24]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a6291d-247f-4db0-9117-f429a3b20fec]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yfhtbsow {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:14 devstack sudo[100394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:01:14 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:15 devstack sudo[100395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yfhtbsow
Jul 03 13:01:15 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:15 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD" returned: 0 in 0.992s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:15 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD
Jul 03 13:01:15 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:15 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 1.175s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:01:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:15 devstack sudo[100407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812 1G
Jul 03 13:01:15 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:16 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yfhtbsow" returned: 0 in 1.243s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yfhtbsow {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:16 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yfhtbsow
Jul 03 13:01:16 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:16 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD" returned: 1 in 0.977s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:01:16 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] 5ee99fac-79c9-4f4a-bc95-9234fc6f8f95 was raw, converting to raw {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jul 03 13:01:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:16 devstack sudo[100415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd
Jul 03 13:01:16 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:17 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yfhtbsow" returned: 1 in 1.040s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yfhtbsow' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:01:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[198217a2-ccfe-447a-ad02-b026bab7ecdc]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:17 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812 1G" returned: 0 in 1.204s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:17 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812
Jul 03 13:01:17 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:17 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD
Jul 03 13:01:17 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:17 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd" returned: 0 in 1.123s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:17 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ee99fac-79c9-4f4a-bc95-9234fc6f8f95_ye29zvxqdevstack@QuobyteHD, size 0.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:01:17 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 13:01:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:17 devstack sudo[100430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd 1G
Jul 03 13:01:17 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:18 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD" returned: 0 in 1.042s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:18 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] 8af9b126-5566-44ac-8948-4fb0a1be3fd3 was qcow2, converting to raw {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jul 03 13:01:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:18 devstack sudo[100440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3
Jul 03 13:01:18 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:18 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812" returned: 0 in 1.282s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:18 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812 is being set with open permissions: ugo+rw
Jul 03 13:01:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:18 devstack sudo[100442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812
Jul 03 13:01:18 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:18 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd 1G" returned: 0 in 1.027s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6de3bd-74cf-4ca3-93a4-91508dfc45a0]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:18 devstack sudo[100447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd
Jul 03 13:01:18 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:19 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812" returned: 0 in 1.040s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.873s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-60d2604a-c868-4d31-b8e6-709d01f27d94 tempest-SnapshotsActionsTest-1990158738 None] Create snapshot completed successfully
Jul 03 13:01:20 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd" returned: 0 in 1.194s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:20 devstack sudo[100461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd
Jul 03 13:01:20 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-cdf21695-0aad-4b00-a576-929882083812-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-cdf21695-0aad-4b00-a576-929882083812-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-quobyte-cdf21695-0aad-4b00-a576-929882083812" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-cdf21695-0aad-4b00-a576-929882083812" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Deleting offline snapshot cdf21695-0aad-4b00-a576-929882083812 of volume ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] snapshot_file for this snap is: volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[51225c59-cd87-4bce-9b42-3a844c594b7c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:21 devstack sudo[100464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812
Jul 03 13:01:21 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:21 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3" returned: 0 in 2.982s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_yzo_i4y_devstack@QuobyteHD, size 112.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:01:21 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Converted 112.00 MB image at 37.54 MB/s
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:21 devstack sudo[100466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 1G
Jul 03 13:01:21 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:21 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd" returned: 1 in 1.499s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Downloaded image 5ee99fac-79c9-4f4a-bc95-9234fc6f8f95 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'metadata': {}}])) to volume 368f5fa5-136d-46e6-9b15-94e47e26a6bd successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Temporary image 5ee99fac-79c9-4f4a-bc95-9234fc6f8f95 for user eb1c34c63cfb482ab06ed8edefbf02f5 is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Marking volume 368f5fa5-136d-46e6-9b15-94e47e26a6bd as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Copying metadata from image 5ee99fac-79c9-4f4a-bc95-9234fc6f8f95 to 368f5fa5-136d-46e6-9b15-94e47e26a6bd. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Creating volume glance metadata for volume 368f5fa5-136d-46e6-9b15-94e47e26a6bd backed by image 5ee99fac-79c9-4f4a-bc95-9234fc6f8f95 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c48f27e4d4cb4ade70a9778b3c279a83', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57006854-278e-47a9-9206-d8856e8eee88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd', 'volume_size': 1, 'image_id': '5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c48f27e4d4cb4ade70a9778b3c279a83', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '203f30a9926144ffb5b9fd92c2f192b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '34a112d0e219661f391e8c5f5aa11dc06815f8234f34a176c7ab8424cb30868cd6b734bacefd3e0bf2ade7b17e78966cbdcf123e4240e129ba981f6ae356b08e', 'id': '5ee99fac-79c9-4f4a-bc95-9234fc6f8f95', 'created_at': datetime.datetime(2026, 7, 3, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 1, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ee99fac-79c9-4f4a-bc95-9234fc6f8f95/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b64cf050>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bd9023-c640-46c2-9c2c-eeaf939e5f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:21 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Volume volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd (368f5fa5-136d-46e6-9b15-94e47e26a6bd): created successfully
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bd9023-c640-46c2-9c2c-eeaf939e5f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Flow 'volume_create_manager' (f795c36c-65d1-41af-8d06-ffed0ea05ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f06f1a58-b456-484c-b862-adb454e79abb tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Created volume successfully.
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Acquiring lock "cinder-368f5fa5-136d-46e6-9b15-94e47e26a6bd-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Lock "cinder-368f5fa5-136d-46e6-9b15-94e47e26a6bd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:22 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 1G" returned: 0 in 1.133s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Acquiring lock "cinder-quobyte-368f5fa5-136d-46e6-9b15-94e47e26a6bd" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:22 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812" returned: 0 in 1.474s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a423cc2-a810-41c4-8780-a717bef15860]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5aa528-e1fa-448d-accd-98a2c897aa63]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Lock "cinder-quobyte-368f5fa5-136d-46e6-9b15-94e47e26a6bd" acquired by "delete_volume" :: waited 0.077s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1894fb51-2c20-442f-bea5-13f7153a481e]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:22 devstack sudo[100478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3
Jul 03 13:01:22 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:22 devstack sudo[100479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:01:22 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:22 devstack sudo[100480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd
Jul 03 13:01:22 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:23 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd" returned: 0 in 1.123s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:23 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3" returned: 0 in 1.296s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:23 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 1.296s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:01:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:23 devstack sudo[100495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812
Jul 03 13:01:23 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:23 devstack sudo[100493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd
Jul 03 13:01:23 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:23 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3
Jul 03 13:01:23 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:24 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd" returned: 1 in 1.165s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:01:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:24 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd
Jul 03 13:01:24 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3" returned: 1 in 1.202s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:01:24 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Downloaded image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}])) to volume 4c830aeb-544f-4a99-8978-152aaf588cd3 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jul 03 13:01:24 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:24 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Temporary image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 for user 4f8cba47146845a08315549866899098 is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jul 03 13:01:24 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Marking volume 4c830aeb-544f-4a99-8978-152aaf588cd3 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Copying metadata from image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 to 4c830aeb-544f-4a99-8978-152aaf588cd3. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Creating volume glance metadata for volume 4c830aeb-544f-4a99-8978-152aaf588cd3 backed by image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:01:25 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812" returned: 0 in 1.335s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:25 devstack sudo[100510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812
Jul 03 13:01:25 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d905da62-37ff-4214-b698-3e4c48509550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c830aeb-544f-4a99-8978-152aaf588cd3', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b61001a0>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e16a1b-5195-4006-9696-797171480d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Volume volume-4c830aeb-544f-4a99-8978-152aaf588cd3 (4c830aeb-544f-4a99-8978-152aaf588cd3): created successfully
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e16a1b-5195-4006-9696-797171480d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Flow 'volume_create_manager' (810141c2-9d2b-415e-ae9e-4ed622860ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-00d410c3-3063-484e-9526-bcece2f0f9f8 tempest-VolumesImageMetadata-594867067 None] Created volume successfully.
Jul 03 13:01:25 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-368f5fa5-136d-46e6-9b15-94e47e26a6bd" returned: 0 in 1.022s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Lock "cinder-quobyte-368f5fa5-136d-46e6-9b15-94e47e26a6bd" released by "delete_volume" :: held 3.421s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Acquiring lock "cinder-4c830aeb-544f-4a99-8978-152aaf588cd3-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Lock "cinder-4c830aeb-544f-4a99-8978-152aaf588cd3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:25 devstack cinder-volume[86763]: WARNING cinder.quota [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:01:25 devstack cinder-volume[86763]: WARNING cinder.quota [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Acquiring lock "cinder-quobyte-4c830aeb-544f-4a99-8978-152aaf588cd3" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Created reservations ['7e19b635-c95c-45f5-bb31-9a0c50ec5502', '1a30e0af-c817-48ce-8aa1-ad3d779c38ea', '2698aadb-e9fe-4864-87e5-6db99095f823', '360f59a6-b819-41d0-8ba4-22e5e0ff9dc3'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Lock "cinder-quobyte-4c830aeb-544f-4a99-8978-152aaf588cd3" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c140640b-365b-4bed-a5dc-12648f66bdb6]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:26 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cdf21695-0aad-4b00-a576-929882083812" returned: 0 in 1.134s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:26 devstack sudo[100515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:01:26 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:26 devstack sudo[100514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3
Jul 03 13:01:26 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-cdf21695-0aad-4b00-a576-929882083812" released by "_delete_snapshot" :: held 5.419s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" released by "delete_snapshot" :: held 5.460s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Created reservations ['01c11e18-998b-4b5d-93ad-4b69d3479167', '67aa920b-4b0d-41d3-84a1-75b157bb7f3a', 'f5008f95-6a76-4851-9a2d-ead061450b22', 'ae7eedd0-b449-43b8-823b-146b32dc8213'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:01:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Delete snapshot completed successfully.
Jul 03 13:01:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e34b9e91-6738-48a6-935a-1f65695cf379 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-cdf21695-0aad-4b00-a576-929882083812-delete_snapshot" released by "delete_snapshot" :: held 5.786s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:27 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.119s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:27 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:01:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Deleted volume successfully.
Jul 03 13:01:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c50c8460-2507-4665-a9e5-d34f04864c87 tempest-VolumeAndVolumeTypeFromImageTest-540464772 None] Lock "cinder-368f5fa5-136d-46e6-9b15-94e47e26a6bd-delete_volume" released by "delete_volume" :: held 5.121s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:27 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3" returned: 0 in 1.566s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:27 devstack sudo[100521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3
Jul 03 13:01:27 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] Creating offline snapshot 03e35aa5-839e-48cb-9290-c76e81fd60a1 of volume ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:01:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9793f8-3154-4f26-a009-8e5568cb808a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:28 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:01:28 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:28 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3" returned: 1 in 1.267s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:01:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:29 devstack sudo[100528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3
Jul 03 13:01:29 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:29 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 1.408s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:01:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:29 devstack sudo[100533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1 1G
Jul 03 13:01:29 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:30 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4c830aeb-544f-4a99-8978-152aaf588cd3" returned: 0 in 1.129s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Lock "cinder-quobyte-4c830aeb-544f-4a99-8978-152aaf588cd3" released by "delete_volume" :: held 4.083s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:30 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=117,cinder:SELECT=113,cinder:DELETE=4,cinder:INSERT=34 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:01:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Created reservations ['aa55fd89-601d-4d09-81bb-da02ed9ff7bc', 'f8172c75-0194-43e3-a548-960b99bc1f7e', '97087392-d88d-4fd6-9806-284503cd23fa', '658eeeae-1e1f-4f2f-bb8f-1a6f3e7d5ef0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:01:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:30 devstack sudo[100539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:01:30 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:31 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1 1G" returned: 0 in 1.607s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:31 devstack sudo[100543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1
Jul 03 13:01:31 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:31 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.421s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:31 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:01:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Deleted volume successfully.
Jul 03 13:01:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-450ad8d1-f35b-43a8-a15e-ddd8b944d3db tempest-VolumesImageMetadata-594867067 None] Lock "cinder-4c830aeb-544f-4a99-8978-152aaf588cd3-delete_volume" released by "delete_volume" :: held 5.913s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:32 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1" returned: 0 in 1.013s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:32 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1 is being set with open permissions: ugo+rw
Jul 03 13:01:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:32 devstack sudo[100549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1
Jul 03 13:01:32 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:33 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1" returned: 0 in 1.177s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:33 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=126,cinder:SELECT=98,cinder:INSERT=42,cinder:DELETE=12 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:01:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.400s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6fbf73c9-32a8-4062-a630-11ec65f296e3 tempest-SnapshotsActionsTest-1990158738 None] Create snapshot completed successfully
Jul 03 13:01:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-03e35aa5-839e-48cb-9290-c76e81fd60a1-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-03e35aa5-839e-48cb-9290-c76e81fd60a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-quobyte-03e35aa5-839e-48cb-9290-c76e81fd60a1" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-03e35aa5-839e-48cb-9290-c76e81fd60a1" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Deleting offline snapshot 03e35aa5-839e-48cb-9290-c76e81fd60a1 of volume ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:01:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] snapshot_file for this snap is: volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:01:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5491135e-a40f-4604-acf6-f7631bab1aa3]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:35 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1
Jul 03 13:01:35 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (d1219674-e3fb-40fe-9cb6-f7800a9101dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5161c76-3e39-43ab-b4f3-4e712da36d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5161c76-3e39-43ab-b4f3-4e712da36d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1259168195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d63407-8b55-48f3-aa08-da69316b6203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:35Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d750082-0e62-479d-895c-81afc621db76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d750082-0e62-479d-895c-81afc621db76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab2d499-479e-49a5-a900-c2bc43151693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab2d499-479e-49a5-a900-c2bc43151693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d63407-8b55-48f3-aa08-da69316b6203', 'volume_name': 'volume-d8d63407-8b55-48f3-aa08-da69316b6203', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275f402f-ac0f-4551-8ed9-3f448b9716d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275f402f-ac0f-4551-8ed9-3f448b9716d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf379a7-d314-4c88-8c86-126adaa79bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume d8d63407-8b55-48f3-aa08-da69316b6203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d63407-8b55-48f3-aa08-da69316b6203', 'volume_size': 1}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1259168195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d63407-8b55-48f3-aa08-da69316b6203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:35Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Creating volume d8d63407-8b55-48f3-aa08-da69316b6203 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:35 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:01:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:35 devstack sudo[100555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203 1073741824
Jul 03 13:01:35 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:36 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1" returned: 0 in 1.711s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:01:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5c2488-869b-4ce5-a941-a3db34de0d40]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:36 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:01:36 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:37 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203 1073741824" returned: 0 in 1.768s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:37 devstack sudo[100567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203
Jul 03 13:01:37 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:37 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:01:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Flow 'volume_create_manager' (4ae67e6c-cff7-4667-be51-beddd7295ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88af09f-566c-42c1-a7c4-815ba8833356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88af09f-566c-42c1-a7c4-815ba8833356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-386527110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b038025-8d25-450b-98ca-92497b97f0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72feec487df641519f772e42ca9a0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:38Z,use_quota=True,user_id='834d5d1581104335bf41ec7a7694fbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3280c5-94b2-4a05-8192-b2f446f226d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3280c5-94b2-4a05-8192-b2f446f226d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceac453e-b340-4a4e-918c-b23adb1f0783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceac453e-b340-4a4e-918c-b23adb1f0783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b038025-8d25-450b-98ca-92497b97f0af', 'volume_name': 'volume-0b038025-8d25-450b-98ca-92497b97f0af', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9c087f-b84a-407e-a8a3-bb35a378c8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9c087f-b84a-407e-a8a3-bb35a378c8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9796e20-f445-4c3f-be70-0f81833b15ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Volume 0b038025-8d25-450b-98ca-92497b97f0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b038025-8d25-450b-98ca-92497b97f0af', 'volume_size': 1}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:38 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 1.710s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:38 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1
Jul 03 13:01:38 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:38 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203" returned: 0 in 1.273s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] <== create_volume: return (3165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.170s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-386527110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b038025-8d25-450b-98ca-92497b97f0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72feec487df641519f772e42ca9a0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:38Z,use_quota=True,user_id='834d5d1581104335bf41ec7a7694fbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Creating volume 0b038025-8d25-450b-98ca-92497b97f0af {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:38 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:38 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af 1073741824
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf379a7-d314-4c88-8c86-126adaa79bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d63407-8b55-48f3-aa08-da69316b6203', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:38 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55503b25-41ce-4944-9464-ee295021ee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume volume-d8d63407-8b55-48f3-aa08-da69316b6203 (d8d63407-8b55-48f3-aa08-da69316b6203): created successfully
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55503b25-41ce-4944-9464-ee295021ee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (d1219674-e3fb-40fe-9cb6-f7800a9101dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bc1f3eb7-c8c3-4b08-ba54-14ad0f201846 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created volume successfully.
Jul 03 13:01:39 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1" returned: 0 in 1.373s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:39 devstack sudo[100584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1
Jul 03 13:01:39 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:40 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af 1073741824" returned: 0 in 1.548s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:01:40 devstack sudo[100588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af
Jul 03 13:01:40 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (944ffc7b-1259-4705-8772-12d810faadd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22e4594-0aa5-4940-a550-3e02abc21572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22e4594-0aa5-4940-a550-3e02abc21572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855367760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905de8aa-b512-45a1-9730-82e7b63b54f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:40Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448e4db5-121f-4326-8831-30ba0611ea58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448e4db5-121f-4326-8831-30ba0611ea58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbd9c90-3454-4449-a868-2bc26b0b1d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbd9c90-3454-4449-a868-2bc26b0b1d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905de8aa-b512-45a1-9730-82e7b63b54f4', 'volume_name': 'volume-905de8aa-b512-45a1-9730-82e7b63b54f4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef53877-0a08-4d91-88bd-0375ae935bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef53877-0a08-4d91-88bd-0375ae935bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2cc6914-181a-4c27-880b-6c43c1045998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:40 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume 905de8aa-b512-45a1-9730-82e7b63b54f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905de8aa-b512-45a1-9730-82e7b63b54f4', 'volume_size': 1}
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:40 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.03e35aa5-839e-48cb-9290-c76e81fd60a1" returned: 0 in 1.238s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-03e35aa5-839e-48cb-9290-c76e81fd60a1" released by "_delete_snapshot" :: held 6.270s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" released by "delete_snapshot" :: held 6.323s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (4259bdce-79c2-4337-a6f4-dacf936e4798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20094e0-c539-4245-ba9e-dac828c410cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20094e0-c539-4245-ba9e-dac828c410cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2121364412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00abe2a-12a4-42c5-839b-798551f85a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:41Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f835ce94-4550-470c-a01e-46388a641fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f835ce94-4550-470c-a01e-46388a641fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfc77fe-87c2-4bda-beb7-cc36def418b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfc77fe-87c2-4bda-beb7-cc36def418b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e00abe2a-12a4-42c5-839b-798551f85a0e', 'volume_name': 'volume-e00abe2a-12a4-42c5-839b-798551f85a0e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf35402-3c83-48e1-80c9-2b4de6d8fa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf35402-3c83-48e1-80c9-2b4de6d8fa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0f54c4-791e-4457-ab30-0845a17497c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:41 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume e00abe2a-12a4-42c5-839b-798551f85a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e00abe2a-12a4-42c5-839b-798551f85a0e', 'volume_size': 1}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Created reservations ['1ea8b32f-ac37-4b82-96c0-c03936fa3f05', 'af07f5d8-b748-4b03-b896-b359ceab671c', 'b67e8d34-2589-493c-833c-5673cb714cbf', '18daf579-a1e3-4210-80ba-df7a94ce2a81'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:01:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Delete snapshot completed successfully.
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-73b97a17-5006-4e3e-a376-b5f97880f064 tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-03e35aa5-839e-48cb-9290-c76e81fd60a1-delete_snapshot" released by "delete_snapshot" :: held 7.206s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:41 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af" returned: 0 in 1.572s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] <== create_volume: return (3227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.233s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (ac3d937b-58e3-44c7-91be-ffcdb8140df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ffb5fb-9a9d-419d-96e0-86b931b47683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855367760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905de8aa-b512-45a1-9730-82e7b63b54f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:40Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Creating volume 905de8aa-b512-45a1-9730-82e7b63b54f4 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:41 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:01:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:42 devstack sudo[100594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4 1073741824
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9796e20-f445-4c3f-be70-0f81833b15ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b038025-8d25-450b-98ca-92497b97f0af', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:42 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936905c2-eb52-4eb1-8a67-95d77d793d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ffb5fb-9a9d-419d-96e0-86b931b47683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531863242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2cc7b4-9b01-4798-bd10-4763d32eb782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:42Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e49ef8-c246-4519-b1cb-7222393fbcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e49ef8-c246-4519-b1cb-7222393fbcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6d1212-bb29-4faa-accb-531efe59fe76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6d1212-bb29-4faa-accb-531efe59fe76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b2cc7b4-9b01-4798-bd10-4763d32eb782', 'volume_name': 'volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fc393d-3371-4659-8403-b4b76db6c34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fc393d-3371-4659-8403-b4b76db6c34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd6e132-1b9a-49ec-ae4b-d699d9395930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:42 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume 7b2cc7b4-9b01-4798-bd10-4763d32eb782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782', 'volume_size': 1}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:42 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Volume volume-0b038025-8d25-450b-98ca-92497b97f0af (0b038025-8d25-450b-98ca-92497b97f0af): created successfully
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936905c2-eb52-4eb1-8a67-95d77d793d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Flow 'volume_create_manager' (4ae67e6c-cff7-4667-be51-beddd7295ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-aadaf314-d4e6-4b99-9312-796176ae6dbc tempest-SnapshotMetadataTestJSON-27135821 None] Created volume successfully.
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (a80b7b01-52c9-4650-ab08-e74634d56f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce4d050-0598-4385-b0df-b4bb3abeabc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce4d050-0598-4385-b0df-b4bb3abeabc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601020638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77c6a3a-1da4-40b1-beec-2ed0611ba64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:43Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d893cb-dba7-43e6-9d48-6e2b0e12e2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d893cb-dba7-43e6-9d48-6e2b0e12e2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b60c043-d8a2-40f9-8e41-1f0873be0d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b60c043-d8a2-40f9-8e41-1f0873be0d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f77c6a3a-1da4-40b1-beec-2ed0611ba64f', 'volume_name': 'volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32bc05a-6da2-42b2-bae5-80018c6fd084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32bc05a-6da2-42b2-bae5-80018c6fd084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3b00a7-013b-4446-b8ed-f10eedaa3d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume f77c6a3a-1da4-40b1-beec-2ed0611ba64f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f', 'volume_size': 1}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (afb13b50-8a08-4b86-bb13-f9017187a807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d383c7-86fa-4750-ba34-9da95eb52231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d383c7-86fa-4750-ba34-9da95eb52231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-529870452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662cb050-31bb-4fa5-ba10-74b5ae35314c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:43Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1e1abc-7c97-4329-a84a-8bf273f4f58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1e1abc-7c97-4329-a84a-8bf273f4f58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961ac146-4dfb-48fb-bd3c-2325b4cc36cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961ac146-4dfb-48fb-bd3c-2325b4cc36cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662cb050-31bb-4fa5-ba10-74b5ae35314c', 'volume_name': 'volume-662cb050-31bb-4fa5-ba10-74b5ae35314c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636460dd-f657-41c5-94a6-52a70976d939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636460dd-f657-41c5-94a6-52a70976d939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fe314c-7a67-46b0-9c1e-cd127863d3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume 662cb050-31bb-4fa5-ba10-74b5ae35314c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662cb050-31bb-4fa5-ba10-74b5ae35314c', 'volume_size': 1}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:43 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4 1073741824" returned: 0 in 1.819s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:43 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4
Jul 03 13:01:43 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:44 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4" returned: 0 in 0.864s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] <== create_volume: return (2743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.746s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.029s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2121364412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00abe2a-12a4-42c5-839b-798551f85a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:41Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Creating volume e00abe2a-12a4-42c5-839b-798551f85a0e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:44 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:44 devstack sudo[100602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e 1073741824
Jul 03 13:01:44 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2cc6914-181a-4c27-880b-6c43c1045998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905de8aa-b512-45a1-9730-82e7b63b54f4', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173efe1d-33e5-41a5-8ca3-7ec69babce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume volume-905de8aa-b512-45a1-9730-82e7b63b54f4 (905de8aa-b512-45a1-9730-82e7b63b54f4): created successfully
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173efe1d-33e5-41a5-8ca3-7ec69babce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (944ffc7b-1259-4705-8772-12d810faadd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-939ee014-e3a4-4cb1-85ef-f14deba1b3f6 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created volume successfully.
Jul 03 13:01:45 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e 1073741824" returned: 0 in 1.048s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:45 devstack sudo[100608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e
Jul 03 13:01:45 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:46 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e" returned: 0 in 0.720s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.396s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531863242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2cc7b4-9b01-4798-bd10-4763d32eb782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:42Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Creating volume 7b2cc7b4-9b01-4798-bd10-4763d32eb782 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:46 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:46 devstack sudo[100611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782 1073741824
Jul 03 13:01:46 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0f54c4-791e-4457-ab30-0845a17497c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00abe2a-12a4-42c5-839b-798551f85a0e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34c4406-d48c-4766-9c61-caddb0cfddf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume volume-e00abe2a-12a4-42c5-839b-798551f85a0e (e00abe2a-12a4-42c5-839b-798551f85a0e): created successfully
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34c4406-d48c-4766-9c61-caddb0cfddf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (4259bdce-79c2-4337-a6f4-dacf936e4798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4be7a23f-c419-439b-b57f-8c25ae7f0562 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created volume successfully.
Jul 03 13:01:47 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782 1073741824" returned: 0 in 1.055s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:47 devstack sudo[100617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782
Jul 03 13:01:47 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:48 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782" returned: 0 in 0.908s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.577s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601020638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77c6a3a-1da4-40b1-beec-2ed0611ba64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:43Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Creating volume f77c6a3a-1da4-40b1-beec-2ed0611ba64f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:48 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd6e132-1b9a-49ec-ae4b-d699d9395930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:48 devstack sudo[100620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f 1073741824
Jul 03 13:01:48 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a047ba85-f447-4151-9840-6c0ac86f8729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:48 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782 (7b2cc7b4-9b01-4798-bd10-4763d32eb782): created successfully
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a047ba85-f447-4151-9840-6c0ac86f8729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (ac3d937b-58e3-44c7-91be-ffcdb8140df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b33b2c3d-5881-4294-98e9-f31822f127fa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created volume successfully.
Jul 03 13:01:49 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f 1073741824" returned: 0 in 0.977s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:49 devstack sudo[100625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f
Jul 03 13:01:49 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:50 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f" returned: 0 in 0.830s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:01:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.463s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] Creating offline snapshot b3c208db-d7e1-4c10-a520-ed6258a4863a of volume ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:01:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3b00a7-013b-4446-b8ed-f10eedaa3d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0060b41c-2182-4f71-bcf5-a42e89ddbfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0188e811-9531-4dac-849b-fc8cc268c1a9]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:50 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f (f77c6a3a-1da4-40b1-beec-2ed0611ba64f): created successfully
Jul 03 13:01:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0060b41c-2182-4f71-bcf5-a42e89ddbfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (a80b7b01-52c9-4650-ab08-e74634d56f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1ac958d1-5ea9-42b4-af27-7e9825d5bd87 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created volume successfully.
Jul 03 13:01:50 devstack sudo[100629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:01:50 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:51 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 0.992s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:01:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:51 devstack sudo[100634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a 1G
Jul 03 13:01:51 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:52 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a 1G" returned: 0 in 1.327s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:52 devstack sudo[100641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a
Jul 03 13:01:52 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:53 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a" returned: 0 in 1.009s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:53 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a is being set with open permissions: ugo+rw
Jul 03 13:01:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:53 devstack sudo[100646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a
Jul 03 13:01:53 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:54 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a" returned: 0 in 0.968s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.445s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.388s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-529870452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662cb050-31bb-4fa5-ba10-74b5ae35314c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f38abd79aa4ed9874612b66703e3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:43Z,use_quota=True,user_id='592820fe3cc649709402a525560763e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Creating volume 662cb050-31bb-4fa5-ba10-74b5ae35314c {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:54 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:01:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:54 devstack sudo[100649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c 1073741824
Jul 03 13:01:54 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9dc8bd6b-1843-41b2-8820-37b4cf88b3f6 tempest-SnapshotsActionsTest-1990158738 None] Create snapshot completed successfully
Jul 03 13:01:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-b3c208db-d7e1-4c10-a520-ed6258a4863a-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-b3c208db-d7e1-4c10-a520-ed6258a4863a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-quobyte-b3c208db-d7e1-4c10-a520-ed6258a4863a" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-b3c208db-d7e1-4c10-a520-ed6258a4863a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Deleting offline snapshot b3c208db-d7e1-4c10-a520-ed6258a4863a of volume ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:01:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] snapshot_file for this snap is: volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:01:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f99836-b7c4-4fad-8723-d389fd6acdef]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:56 devstack sudo[100688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a
Jul 03 13:01:56 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:56 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c 1073741824" returned: 0 in 1.263s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:56 devstack sudo[100692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c
Jul 03 13:01:56 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:57 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a" returned: 0 in 1.250s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12e4c31-36da-4599-b58f-36c962e2adbf]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:57 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c" returned: 0 in 1.017s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] <== create_volume: return (2347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.350s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.592s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] Creating offline snapshot 27cdefb9-49e4-4594-a23f-08ebebd03db2 of volume 0b038025-8d25-450b-98ca-92497b97f0af {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fe314c-7a67-46b0-9c1e-cd127863d3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662cb050-31bb-4fa5-ba10-74b5ae35314c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c56c0a-cb2a-4e54-bb18-363d63c7f5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68b45c4-2efb-4a4d-9e83-935dd50dea29]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Volume volume-662cb050-31bb-4fa5-ba10-74b5ae35314c (662cb050-31bb-4fa5-ba10-74b5ae35314c): created successfully
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c56c0a-cb2a-4e54-bb18-363d63c7f5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Flow 'volume_create_manager' (afb13b50-8a08-4b86-bb13-f9017187a807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:57 devstack sudo[100698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:01:57 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f99c7c24-fdf0-4dcc-9086-790bb885a221 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created volume successfully.
Jul 03 13:01:57 devstack sudo[100699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af
Jul 03 13:01:57 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-662cb050-31bb-4fa5-ba10-74b5ae35314c-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-662cb050-31bb-4fa5-ba10-74b5ae35314c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-quobyte-662cb050-31bb-4fa5-ba10-74b5ae35314c" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-662cb050-31bb-4fa5-ba10-74b5ae35314c" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:58 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ae8902-2ce4-4c48-aabc-e0922fb7391d]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:58 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af" returned: 0 in 1.105s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:58 devstack sudo[100710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2 1G
Jul 03 13:01:58 devstack sudo[100708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c
Jul 03 13:01:58 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:58 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:58 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 1.307s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:01:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:58 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a
Jul 03 13:01:58 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:59 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c" returned: 0 in 1.074s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:59 devstack sudo[100726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c
Jul 03 13:01:59 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:59 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2 1G" returned: 0 in 1.133s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b038025-8d25-450b-98ca-92497b97f0af -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:59 devstack sudo[100728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b038025-8d25-450b-98ca-92497b97f0af -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2
Jul 03 13:01:59 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:59 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a" returned: 0 in 1.148s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:59 devstack sudo[100730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a
Jul 03 13:01:59 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-662cb050-31bb-4fa5-ba10-74b5ae35314c" returned: 0 in 1.199s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:00 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-662cb050-31bb-4fa5-ba10-74b5ae35314c" released by "delete_volume" :: held 2.347s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:00 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.b3c208db-d7e1-4c10-a520-ed6258a4863a" returned: 0 in 0.999s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created reservations ['ad497aae-da15-4060-9076-08d0c1547544', '92a8c7b2-f1e7-4bd0-ac9d-e3c46d629a6e', '35bdf522-e344-4726-8d28-b43e4f5a0b03', '99897f16-2fab-4e18-b988-b28cfbf45d7b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-b3c208db-d7e1-4c10-a520-ed6258a4863a" released by "_delete_snapshot" :: held 4.858s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:00 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" released by "delete_snapshot" :: held 4.898s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b038025-8d25-450b-98ca-92497b97f0af -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2" returned: 0 in 1.163s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:00 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2 is being set with open permissions: ugo+rw
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:00 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2
Jul 03 13:02:00 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Created reservations ['e37e0e89-1e43-4369-9d1e-56fbacb098d6', '965f1e7a-9916-40dd-9eab-e5553366837a', 'c96b0360-eb9a-46e9-9783-c9710fd03560', 'c88f60d1-5416-4b63-bc6c-f0814eedf5c2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:00 devstack sudo[100744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:00 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Delete snapshot completed successfully.
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-872f5256-63cf-4312-8183-e6f6547cec6e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-b3c208db-d7e1-4c10-a520-ed6258a4863a-delete_snapshot" released by "delete_snapshot" :: held 5.238s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-f77c6a3a-1da4-40b1-beec-2ed0611ba64f-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-f77c6a3a-1da4-40b1-beec-2ed0611ba64f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-quobyte-f77c6a3a-1da4-40b1-beec-2ed0611ba64f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-f77c6a3a-1da4-40b1-beec-2ed0611ba64f" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a133efce-2f8a-4ac7-815d-013eeb078c8a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:01 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.988s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:02:01 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Deleted volume successfully.
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2" returned: 0 in 1.133s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cf305af8-5493-4a04-9c6c-5ce199e069aa tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-662cb050-31bb-4fa5-ba10-74b5ae35314c-delete_volume" released by "delete_volume" :: held 3.761s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:02 devstack sudo[100750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f
Jul 03 13:02:02 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:02 devstack sudo[100751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.info
Jul 03 13:02:02 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:02 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.info" returned: 0 in 0.827s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:02 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.info is being set with open permissions: ugo+rw
Jul 03 13:02:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:02 devstack sudo[100758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.info
Jul 03 13:02:02 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:02 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f" returned: 0 in 0.982s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:02 devstack sudo[100760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f
Jul 03 13:02:02 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:03 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.info" returned: 0 in 0.686s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.219s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.818s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:03 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] Creating offline snapshot 69bb9065-7ddc-463c-b110-e5081f49cbaa of volume ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f77c6a3a-1da4-40b1-beec-2ed0611ba64f" returned: 0 in 0.779s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f166614-9301-4c78-9e1a-ca2d27d93a80]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-f77c6a3a-1da4-40b1-beec-2ed0611ba64f" released by "delete_volume" :: held 1.843s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-da8cea42-aa34-4b07-b40e-8adbf16f92c8 tempest-SnapshotMetadataTestJSON-27135821 None] Create snapshot completed successfully
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created reservations ['b06179e8-699f-43ff-8c0a-4efa3d5769ee', '733a511e-77fb-4c82-aa3a-c9241ac82650', '6d7c7a1f-e710-4c57-b190-10bd8cdcf287', '9d05312f-bdb1-45d1-8a9d-237935b377bb'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:03 devstack sudo[100764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:02:03 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:03 devstack sudo[100766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:03 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-7b2cc7b4-9b01-4798-bd10-4763d32eb782-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-7b2cc7b4-9b01-4798-bd10-4763d32eb782-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-quobyte-7b2cc7b4-9b01-4798-bd10-4763d32eb782" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-7b2cc7b4-9b01-4798-bd10-4763d32eb782" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b96a090-2cc9-4637-9905-2a5c5bfc8991]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:04 devstack sudo[100774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782
Jul 03 13:02:04 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:04 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 0.956s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:04 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa 1G
Jul 03 13:02:04 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:04 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.783s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:02:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Deleted volume successfully.
Jul 03 13:02:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8530c993-3c7e-4771-9893-bb7f17ad81d9 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-f77c6a3a-1da4-40b1-beec-2ed0611ba64f-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:05 devstack sudo[100786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:05 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:05 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782" returned: 0 in 1.024s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:05 devstack sudo[100788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782
Jul 03 13:02:05 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Acquiring lock "cinder-27cdefb9-49e4-4594-a23f-08ebebd03db2-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Lock "cinder-27cdefb9-49e4-4594-a23f-08ebebd03db2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Acquiring lock "cinder-quobyte-0b038025-8d25-450b-98ca-92497b97f0af" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Lock "cinder-quobyte-0b038025-8d25-450b-98ca-92497b97f0af" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Acquiring lock "cinder-quobyte-27cdefb9-49e4-4594-a23f-08ebebd03db2" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Lock "cinder-quobyte-27cdefb9-49e4-4594-a23f-08ebebd03db2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Deleting offline snapshot 27cdefb9-49e4-4594-a23f-08ebebd03db2 of volume 0b038025-8d25-450b-98ca-92497b97f0af {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:02:06 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] snapshot_file for this snap is: volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.985s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2ca1f5-5151-4f8f-905a-157f0369082a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:06 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa 1G" returned: 0 in 1.459s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:06 devstack sudo[100796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa
Jul 03 13:02:06 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:06 devstack sudo[100795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2
Jul 03 13:02:06 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:06 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b2cc7b4-9b01-4798-bd10-4763d32eb782" returned: 0 in 1.150s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-7b2cc7b4-9b01-4798-bd10-4763d32eb782" released by "delete_volume" :: held 2.240s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created reservations ['82f80e37-3a68-412d-a5d8-13bb9bc6820f', '4a50cb4d-acb3-4419-bfce-cb7969412873', '4e190d7f-0245-4bc9-a28b-db98791222fa', '7511f2c3-d353-48f9-8a58-abb67969bd2a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:06 devstack sudo[100799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:06 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:07 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa" returned: 0 in 1.146s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:07 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa is being set with open permissions: ugo+rw
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:07 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2" returned: 0 in 1.196s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:07 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa
Jul 03 13:02:07 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b038025-8d25-450b-98ca-92497b97f0af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[305fca01-2827-45b4-8170-3f5543bb8436]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:07 devstack sudo[100811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af
Jul 03 13:02:07 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-e00abe2a-12a4-42c5-839b-798551f85a0e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-e00abe2a-12a4-42c5-839b-798551f85a0e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-quobyte-e00abe2a-12a4-42c5-839b-798551f85a0e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-e00abe2a-12a4-42c5-839b-798551f85a0e" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[752ea686-8917-4743-9331-6cf9eaf523b1]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:07 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.292s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:02:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Deleted volume successfully.
Jul 03 13:02:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e03d7d85-4d5f-4cf9-91de-9b30e8b2247e tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-7b2cc7b4-9b01-4798-bd10-4763d32eb782-delete_volume" released by "delete_volume" :: held 3.874s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:07 devstack sudo[100818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e
Jul 03 13:02:07 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:08 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa" returned: 0 in 1.239s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.999s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-96feabca-8534-4dee-a3d2-d13cacd5e938 tempest-SnapshotsActionsTest-1990158738 None] Create snapshot completed successfully
Jul 03 13:02:08 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af" returned: 0 in 1.298s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:08 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2
Jul 03 13:02:08 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:08 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e" returned: 0 in 1.163s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:08 devstack sudo[100845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e
Jul 03 13:02:08 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-69bb9065-7ddc-463c-b110-e5081f49cbaa-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-69bb9065-7ddc-463c-b110-e5081f49cbaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Acquiring lock "cinder-quobyte-69bb9065-7ddc-463c-b110-e5081f49cbaa" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-69bb9065-7ddc-463c-b110-e5081f49cbaa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Deleting offline snapshot 69bb9065-7ddc-463c-b110-e5081f49cbaa of volume ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] snapshot_file for this snap is: volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3409da5c-cb13-4445-9715-b8cc5113ce2e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:09 devstack sudo[100851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa
Jul 03 13:02:09 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:09 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2" returned: 0 in 1.069s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:09 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2
Jul 03 13:02:09 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:09 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e00abe2a-12a4-42c5-839b-798551f85a0e" returned: 0 in 0.995s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-e00abe2a-12a4-42c5-839b-798551f85a0e" released by "delete_volume" :: held 2.226s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created reservations ['538303b0-c279-45fe-99f5-871603d96a51', '84a53901-b713-4981-9d8b-a40e8e099271', 'b805dc84-c212-4330-b712-ae60e3579f3a', '1d3b349b-08c6-44d3-b7b2-b99d962753f9'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:10 devstack sudo[100856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:10 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:10 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa" returned: 0 in 1.026s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b201c0db-2296-47cc-91ca-039953d8c7b5]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:10 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af.27cdefb9-49e4-4594-a23f-08ebebd03db2" returned: 0 in 0.900s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Lock "cinder-quobyte-27cdefb9-49e4-4594-a23f-08ebebd03db2" released by "_delete_snapshot" :: held 4.652s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Lock "cinder-quobyte-0b038025-8d25-450b-98ca-92497b97f0af" released by "delete_snapshot" :: held 4.682s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Created reservations ['e6cf9fea-5eef-4488-84bd-d006a0ca9359', 'bb187924-ba76-4556-b43c-0226ce5dba68', '8c612607-e074-41a9-9f47-03c337c3daaa', '8ee79cac-2f8b-483a-8d73-d512c7f9f2fd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:10 devstack sudo[100863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:02:10 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Delete snapshot completed successfully.
Jul 03 13:02:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9202e8f7-c957-444c-908b-c64b32d6a2c3 tempest-SnapshotMetadataTestJSON-27135821 None] Lock "cinder-27cdefb9-49e4-4594-a23f-08ebebd03db2-delete_snapshot" released by "delete_snapshot" :: held 4.848s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-905de8aa-b512-45a1-9730-82e7b63b54f4-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-905de8aa-b512-45a1-9730-82e7b63b54f4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-quobyte-905de8aa-b512-45a1-9730-82e7b63b54f4" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:11 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.987s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:02:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Deleted volume successfully.
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-905de8aa-b512-45a1-9730-82e7b63b54f4" acquired by "delete_volume" :: waited 0.048s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-264b41b0-e905-4a32-856d-19c443777446 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-e00abe2a-12a4-42c5-839b-798551f85a0e-delete_volume" released by "delete_volume" :: held 3.663s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9b1e28-c25a-4175-b0df-225af0c9dac3]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:11 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4
Jul 03 13:02:11 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Acquiring lock "cinder-0b038025-8d25-450b-98ca-92497b97f0af-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Lock "cinder-0b038025-8d25-450b-98ca-92497b97f0af-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Acquiring lock "cinder-quobyte-0b038025-8d25-450b-98ca-92497b97f0af" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Lock "cinder-quobyte-0b038025-8d25-450b-98ca-92497b97f0af" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e70288-7000-46da-8025-7e3988c79158]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:11 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 1.284s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:02:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:11 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa
Jul 03 13:02:11 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:11 devstack sudo[100871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af
Jul 03 13:02:11 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:12 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4" returned: 0 in 1.178s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:12 devstack sudo[100878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4
Jul 03 13:02:12 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:12 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af" returned: 0 in 0.933s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:12 devstack sudo[100887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af
Jul 03 13:02:12 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:12 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa" returned: 0 in 0.931s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:12 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa
Jul 03 13:02:12 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:13 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-905de8aa-b512-45a1-9730-82e7b63b54f4" returned: 0 in 0.931s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-905de8aa-b512-45a1-9730-82e7b63b54f4" released by "delete_volume" :: held 2.186s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created reservations ['12a3519a-96dc-4217-bf30-4d7826897fc7', 'b2bd5e11-82f6-4c92-8c2b-5102201cbf90', 'f1065e9b-9c01-4f1e-aca9-069f2e5d07a7', 'b4d9a003-4e38-4781-9477-6f3881dc92c9'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:13 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.69bb9065-7ddc-463c-b110-e5081f49cbaa" returned: 0 in 0.798s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:13 devstack sudo[100897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:13 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-69bb9065-7ddc-463c-b110-e5081f49cbaa" released by "_delete_snapshot" :: held 4.148s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" released by "delete_snapshot" :: held 4.187s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:13 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b038025-8d25-450b-98ca-92497b97f0af" returned: 0 in 0.904s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Lock "cinder-quobyte-0b038025-8d25-450b-98ca-92497b97f0af" released by "delete_volume" :: held 1.949s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Created reservations ['cdcae747-19ac-4761-b40c-6967744e2134', '0858be27-9e8f-4b2d-81ee-54c1bed006db', '6586a79b-c10e-44c1-9c19-7d370d4d21a4', '9fa19b2c-35ca-4935-967a-4fa794481cc1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Created reservations ['4837b7f3-8564-40ae-acc1-da513f318f00', 'ca9587f9-b6a5-4b42-9eb4-41f12af80d98', '6051cf2e-e1a0-423a-8375-0904422e36e9', 'afe36518-d2ac-4efe-a6f6-d45d50f10403'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Delete snapshot completed successfully.
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-438ebf65-dc2b-4473-8cd8-1ab9b01cfc8e tempest-SnapshotsActionsTest-1538487916 None] Lock "cinder-69bb9065-7ddc-463c-b110-e5081f49cbaa-delete_snapshot" released by "delete_snapshot" :: held 4.435s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:13 devstack sudo[100899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:13 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:14 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.754s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:02:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Deleted volume successfully.
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ad022b00-ad1f-43d8-b15e-018e727e7c5d tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-905de8aa-b512-45a1-9730-82e7b63b54f4-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-d8d63407-8b55-48f3-aa08-da69316b6203-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-d8d63407-8b55-48f3-aa08-da69316b6203-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "cinder-quobyte-d8d63407-8b55-48f3-aa08-da69316b6203" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:14 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.780s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:02:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Deleted volume successfully.
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-d8d63407-8b55-48f3-aa08-da69316b6203" acquired by "delete_volume" :: waited 0.125s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ca865bfc-dd73-43c8-b0d4-2403c7e6448e tempest-SnapshotMetadataTestJSON-27135821 None] Lock "cinder-0b038025-8d25-450b-98ca-92497b97f0af-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f62b14-eb8c-4260-8165-e61356244db8]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:15 devstack sudo[100924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203
Jul 03 13:02:15 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "cinder-cb98aadd-d30c-428e-a96f-4c5866356c49-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Lock "cinder-cb98aadd-d30c-428e-a96f-4c5866356c49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "cinder-quobyte-cb98aadd-d30c-428e-a96f-4c5866356c49" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Lock "cinder-quobyte-cb98aadd-d30c-428e-a96f-4c5866356c49" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Deleting offline snapshot cb98aadd-d30c-428e-a96f-4c5866356c49 of volume ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] snapshot_file for this snap is: volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaf9538-b0da-42d8-8644-102408c9f706]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:16 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:02:16 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:16 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203" returned: 0 in 1.845s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:16 devstack sudo[100977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203
Jul 03 13:02:16 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:17 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 1.485s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad75e32a-6b41-43df-98b4-99da658b18d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:02:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4696451c-0fea-4146-ab4a-c009c4d6ba21]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:18 devstack sudo[100983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1
Jul 03 13:02:18 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:18 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d8d63407-8b55-48f3-aa08-da69316b6203" returned: 0 in 1.551s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-quobyte-d8d63407-8b55-48f3-aa08-da69316b6203" released by "delete_volume" :: held 3.475s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Created reservations ['bab06a8f-ed9a-437f-9cfc-59f8643f8d81', 'f41a1d60-84df-451f-a6ad-f2c9f8fe3852', '5400b8a2-9dd1-4b85-934e-50f54d8ba33e', 'd07c8dec-b70b-45aa-8ed0-0cf93edd5d02'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:18 devstack sudo[100986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:18 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:19 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1" returned: 0 in 1.948s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:19 devstack sudo[100992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:02:19 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:19 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.295s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:02:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Deleted volume successfully.
Jul 03 13:02:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6795860f-0f86-4a5b-abac-c59787487e61 tempest-CreateVolumesFromSourceVolumeTest-1298468098 None] Lock "cinder-d8d63407-8b55-48f3-aa08-da69316b6203-delete_volume" released by "delete_volume" :: held 5.465s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:21 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 1.619s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:21 devstack sudo[101000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49
Jul 03 13:02:21 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:22 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1.cb98aadd-d30c-428e-a96f-4c5866356c49" returned: 0 in 1.333s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Lock "cinder-quobyte-cb98aadd-d30c-428e-a96f-4c5866356c49" released by "_delete_snapshot" :: held 6.645s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" released by "delete_snapshot" :: held 6.692s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:23 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Created reservations ['248b9792-7304-46cb-9fd4-88ad0d656996', '1c42e0a0-51e1-48e4-9bbf-54be3436e566', 'c5d044ea-c005-4f12-9f54-fd099e0b8ec7', '7808436e-ac83-477e-90fa-0f41ff537359'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Delete snapshot completed successfully.
Jul 03 13:02:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cbee452e-134b-4b95-bc08-4cf61d9622e2 tempest-SnapshotsActionsTest-1990158738 None] Lock "cinder-cb98aadd-d30c-428e-a96f-4c5866356c49-delete_snapshot" released by "delete_snapshot" :: held 7.076s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "cinder-ad75e32a-6b41-43df-98b4-99da658b18d1-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Lock "cinder-ad75e32a-6b41-43df-98b4-99da658b18d1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:24 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fedbb6c-4651-4e73-9ee9-e7e13216e044]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:24 devstack sudo[101003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1
Jul 03 13:02:24 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:25 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1" returned: 0 in 1.121s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:25 devstack sudo[101009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1
Jul 03 13:02:25 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Flow 'volume_create_manager' (5a322040-cb71-47ab-8807-363837d91acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4619fecb-b85b-4cfb-9af8-5156dbbe87da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4619fecb-b85b-4cfb-9af8-5156dbbe87da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1265394588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da561f49-a27c-422c-931e-65e178abb4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9469eb0a074c63bbc8f175cdfea851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:25Z,use_quota=True,user_id='efd8fb15f5f641a6aa5b60970080a06a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa019d3-64f4-4710-8df2-2605a09c36bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa019d3-64f4-4710-8df2-2605a09c36bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16e67fa-1040-4bd5-bfff-6179f59377f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16e67fa-1040-4bd5-bfff-6179f59377f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da561f49-a27c-422c-931e-65e178abb4a7', 'volume_name': 'volume-da561f49-a27c-422c-931e-65e178abb4a7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c821531-fcb9-48c3-ac7a-7a2c2f3abe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c821531-fcb9-48c3-ac7a-7a2c2f3abe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9391fb38-6aeb-4d4a-95ff-3323c5fa887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Volume da561f49-a27c-422c-931e-65e178abb4a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da561f49-a27c-422c-931e-65e178abb4a7', 'volume_size': 1}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1265394588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da561f49-a27c-422c-931e-65e178abb4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9469eb0a074c63bbc8f175cdfea851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:25Z,use_quota=True,user_id='efd8fb15f5f641a6aa5b60970080a06a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Creating volume da561f49-a27c-422c-931e-65e178abb4a7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:02:25 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:02:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:25 devstack sudo[101011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 1073741824
Jul 03 13:02:25 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:26 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad75e32a-6b41-43df-98b4-99da658b18d1" returned: 0 in 0.925s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Lock "cinder-quobyte-ad75e32a-6b41-43df-98b4-99da658b18d1" released by "delete_volume" :: held 2.140s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:26 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Created reservations ['0614ca57-ff86-419c-80b7-22bba11fe824', 'aa6af85e-b242-4cac-8386-a031ae1943a5', '4c845cb6-5bb2-458a-b0e8-0a2e3ebba37a', 'f590b481-295b-4078-97e3-d3b9f9610ac2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:26 devstack sudo[101014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:26 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:26 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 1073741824" returned: 0 in 1.336s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:27 devstack sudo[101020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7
Jul 03 13:02:27 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:27 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.953s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:27 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:02:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Deleted volume successfully.
Jul 03 13:02:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-555274fc-9b1b-45e6-acf0-a0bbb52aa47a tempest-SnapshotsActionsTest-1990158738 None] Lock "cinder-ad75e32a-6b41-43df-98b4-99da658b18d1-delete_volume" released by "delete_volume" :: held 3.546s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:28 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7" returned: 0 in 1.085s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] <== create_volume: return (2484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.488s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9391fb38-6aeb-4d4a-95ff-3323c5fa887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da561f49-a27c-422c-931e-65e178abb4a7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a566427-7331-40fb-83db-f6637538287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Volume volume-da561f49-a27c-422c-931e-65e178abb4a7 (da561f49-a27c-422c-931e-65e178abb4a7): created successfully
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a566427-7331-40fb-83db-f6637538287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Flow 'volume_create_manager' (5a322040-cb71-47ab-8807-363837d91acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6ae16143-7f06-40a0-a18b-dfdd692d0ab0 tempest-VolumeDependencyTests-471460911 None] Created volume successfully.
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Flow 'volume_create_manager' (23405c7d-1f40-494e-8eb9-5d5671ff2aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c82861b-c668-4887-93ae-1f773c0060a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c82861b-c668-4887-93ae-1f773c0060a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-54266775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f0b757-5c74-43a2-875b-60521fea1c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2abf96a3c0d04f10a9d750f55986a11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:29Z,use_quota=True,user_id='e8702be9397849d0bea66dfadfeaf8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a51c635-551d-4ce2-9909-4b71023ee3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a51c635-551d-4ce2-9909-4b71023ee3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c3ed2a-0fbb-41ec-9f76-d5c5a67a5090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c3ed2a-0fbb-41ec-9f76-d5c5a67a5090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93f0b757-5c74-43a2-875b-60521fea1c61', 'volume_name': 'volume-93f0b757-5c74-43a2-875b-60521fea1c61', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9527aa9f-4420-4d04-a6b2-61dbea82dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9527aa9f-4420-4d04-a6b2-61dbea82dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73948bf5-9103-4b80-9d50-d46ae1674693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:28 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Volume 93f0b757-5c74-43a2-875b-60521fea1c61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93f0b757-5c74-43a2-875b-60521fea1c61', 'volume_size': 1}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-54266775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f0b757-5c74-43a2-875b-60521fea1c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2abf96a3c0d04f10a9d750f55986a11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:29Z,use_quota=True,user_id='e8702be9397849d0bea66dfadfeaf8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Creating volume 93f0b757-5c74-43a2-875b-60521fea1c61 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:02:28 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:02:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:28 devstack sudo[101024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61 1073741824
Jul 03 13:02:28 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:30 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61 1073741824" returned: 0 in 1.367s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:30 devstack sudo[101030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61
Jul 03 13:02:30 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:31 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61" returned: 0 in 0.928s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] <== create_volume: return (2384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.387s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.816s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:INSERT=30,cinder:UPDATE=117,cinder:SELECT=91,cinder:DELETE=13 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73948bf5-9103-4b80-9d50-d46ae1674693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93f0b757-5c74-43a2-875b-60521fea1c61', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cd4458-9048-488d-9612-bb28aa81cfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] Creating offline snapshot 47fc4926-f7f0-46fe-bef4-7661ca51442f of volume da561f49-a27c-422c-931e-65e178abb4a7 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:02:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Volume volume-93f0b757-5c74-43a2-875b-60521fea1c61 (93f0b757-5c74-43a2-875b-60521fea1c61): created successfully
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cd4458-9048-488d-9612-bb28aa81cfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Flow 'volume_create_manager' (23405c7d-1f40-494e-8eb9-5d5671ff2aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be140b8-69ff-44b4-867a-11449ac2b99c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-35fa053e-3d6d-4d33-8a37-3b262761c0af tempest-VolumesTransfersTest-1775340629 None] Created volume successfully.
Jul 03 13:02:31 devstack sudo[101051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7
Jul 03 13:02:31 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:32 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7" returned: 0 in 1.120s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:32 devstack sudo[101056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f 1G
Jul 03 13:02:32 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-faaedb4a-2db9-4405-b6b2-ece9c863d78f tempest-VolumesTransfersTest-1384157173 None] Transfer volume completed successfully.
Jul 03 13:02:33 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f 1G" returned: 0 in 1.126s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da561f49-a27c-422c-931e-65e178abb4a7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:33 devstack sudo[101062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da561f49-a27c-422c-931e-65e178abb4a7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f
Jul 03 13:02:33 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Acquiring lock "cinder-93f0b757-5c74-43a2-875b-60521fea1c61-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Lock "cinder-93f0b757-5c74-43a2-875b-60521fea1c61-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:34 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:DELETE=9,cinder:UPDATE=135,cinder:SELECT=98,cinder:INSERT=34 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:02:34 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da561f49-a27c-422c-931e-65e178abb4a7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f" returned: 0 in 0.912s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:34 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f is being set with open permissions: ugo+rw
Jul 03 13:02:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:34 devstack sudo[101068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f
Jul 03 13:02:34 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Acquiring lock "cinder-quobyte-93f0b757-5c74-43a2-875b-60521fea1c61" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Lock "cinder-quobyte-93f0b757-5c74-43a2-875b-60521fea1c61" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610a369-7ccb-4879-8c64-d662a78bbe5b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:34 devstack sudo[101070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61
Jul 03 13:02:34 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:35 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f" returned: 0 in 0.908s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:35 devstack sudo[101076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.info
Jul 03 13:02:35 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:35 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61" returned: 0 in 0.961s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:35 devstack sudo[101078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61
Jul 03 13:02:35 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:36 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.info" returned: 0 in 0.938s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:36 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.info is being set with open permissions: ugo+rw
Jul 03 13:02:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:36 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-93f0b757-5c74-43a2-875b-60521fea1c61" returned: 0 in 0.854s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:36 devstack sudo[101082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.info
Jul 03 13:02:36 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Lock "cinder-quobyte-93f0b757-5c74-43a2-875b-60521fea1c61" released by "delete_volume" :: held 1.880s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Created reservations ['c7838678-b6e1-435c-ab14-1714bbe98a11', '9660b3cb-8bec-4798-8520-060606cf8b59', 'abe150e9-eeb7-40c4-a445-69eca1c2aa60', 'e7984991-5070-466b-9ea1-16b8b0595cd4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:36 devstack sudo[101084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:36 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:37 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.info" returned: 0 in 0.812s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.982s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-97dc0d66-db04-461f-8a1d-53d7e0d39aaa tempest-VolumeDependencyTests-471460911 None] Create snapshot completed successfully
Jul 03 13:02:37 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.838s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:02:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Deleted volume successfully.
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Flow 'volume_create_manager' (baeecd9e-642b-4ed4-babb-babcc9ce8a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f923b7e5-023b-49da-800b-64a3e8a68c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e21edfac-00b3-45e9-96b2-35c860f8c311 tempest-VolumesTransfersTest-1763838364 None] Lock "cinder-93f0b757-5c74-43a2-875b-60521fea1c61-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f923b7e5-023b-49da-800b-64a3e8a68c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1375813110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e24204-c3b5-4a80-9dd7-4f53401b0661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2abf96a3c0d04f10a9d750f55986a11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:37Z,use_quota=True,user_id='e8702be9397849d0bea66dfadfeaf8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7fd636-6557-4626-aeea-69fbd86c64cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7fd636-6557-4626-aeea-69fbd86c64cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9fc809-7b21-4f37-899a-55736524d135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9fc809-7b21-4f37-899a-55736524d135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e24204-c3b5-4a80-9dd7-4f53401b0661', 'volume_name': 'volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192e3d7a-5766-46bb-9100-b9f7db648269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192e3d7a-5766-46bb-9100-b9f7db648269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1910a149-a6b0-4425-9fd6-d303c2f8992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:37 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Volume f2e24204-c3b5-4a80-9dd7-4f53401b0661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661', 'volume_size': 1}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1375813110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e24204-c3b5-4a80-9dd7-4f53401b0661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2abf96a3c0d04f10a9d750f55986a11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:37Z,use_quota=True,user_id='e8702be9397849d0bea66dfadfeaf8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Creating volume f2e24204-c3b5-4a80-9dd7-4f53401b0661 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:02:37 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:02:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:37 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661 1073741824
Jul 03 13:02:37 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Flow 'volume_create_manager' (f32c4da7-d908-46ad-add8-b21ed600634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4125bac4-d73b-41f1-a8c7-0caefa5d5b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4125bac4-d73b-41f1-a8c7-0caefa5d5b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1440630608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded00cdf-89cb-4563-82a0-f0dfcebbad2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9469eb0a074c63bbc8f175cdfea851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=47fc4926-f7f0-46fe-bef4-7661ca51442f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:38Z,use_quota=True,user_id='efd8fb15f5f641a6aa5b60970080a06a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7104de87-2116-4e2c-b6e1-80c09402a94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7104de87-2116-4e2c-b6e1-80c09402a94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a8c96d-17a7-43aa-be2a-c3a13ced10e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a8c96d-17a7-43aa-be2a-c3a13ced10e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ded00cdf-89cb-4563-82a0-f0dfcebbad2d', 'volume_name': 'volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d', 'volume_size': 1, 'snapshot_id': '47fc4926-f7f0-46fe-bef4-7661ca51442f'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617cd2ab-7420-4cae-bca4-1ae86da74de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617cd2ab-7420-4cae-bca4-1ae86da74de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70564849-b4f6-4db6-9350-580a2e0c79e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Volume ded00cdf-89cb-4563-82a0-f0dfcebbad2d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d', 'volume_size': 1, 'snapshot_id': '47fc4926-f7f0-46fe-bef4-7661ca51442f'}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:38 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661 1073741824" returned: 0 in 1.331s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:38 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661
Jul 03 13:02:38 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:39 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661" returned: 0 in 1.022s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] <== create_volume: return (2430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.433s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.232s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Acquiring lock "cinder-quobyte-47fc4926-f7f0-46fe-bef4-7661ca51442f-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1910a149-a6b0-4425-9fd6-d303c2f8992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c100712a-b073-4282-b134-c8f8993bbe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-47fc4926-f7f0-46fe-bef4-7661ca51442f-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Creating volume ded00cdf-89cb-4563-82a0-f0dfcebbad2d from snapshot 47fc4926-f7f0-46fe-bef4-7661ca51442f {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Acquiring lock "cinder-quobyte-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:39 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Volume volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661 (f2e24204-c3b5-4a80-9dd7-4f53401b0661): created successfully
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c100712a-b073-4282-b134-c8f8993bbe99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Flow 'volume_create_manager' (baeecd9e-642b-4ed4-babb-babcc9ce8a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] snapshot: 47fc4926-f7f0-46fe-bef4-7661ca51442f, volume: ded00cdf-89cb-4563-82a0-f0dfcebbad2d,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:02:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f0058017-e4a8-4851-a7dc-e616976ccb66 tempest-VolumesTransfersTest-1775340629 None] Created volume successfully.
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:40 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5360d482-5774-4407-9249-1778cca956ae]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:40 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f
Jul 03 13:02:40 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:40 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f" returned: 0 in 0.989s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da561f49-a27c-422c-931e-65e178abb4a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:02:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:02:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:02:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[826c72df-c6dd-4b4e-a86f-0d73cfb327e5]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Acquiring lock "cinder-f2e24204-c3b5-4a80-9dd7-4f53401b0661-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Lock "cinder-f2e24204-c3b5-4a80-9dd7-4f53401b0661-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Acquiring lock "cinder-quobyte-f2e24204-c3b5-4a80-9dd7-4f53401b0661" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:41 devstack sudo[101106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7
Jul 03 13:02:41 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Lock "cinder-quobyte-f2e24204-c3b5-4a80-9dd7-4f53401b0661" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc54c4-77a6-4c8b-a82c-53739e6e363e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:41 devstack sudo[101108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661
Jul 03 13:02:41 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:42 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7" returned: 0 in 1.270s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:42 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 13:02:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:42 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661" returned: 0 in 1.013s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:42 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d
Jul 03 13:02:42 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:42 devstack sudo[101120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661
Jul 03 13:02:42 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Flow 'volume_create_manager' (07873b16-7726-4bc2-ab3c-2c7cb20cbff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dacf9d1-4e35-4723-9150-cce349d847d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dacf9d1-4e35-4723-9150-cce349d847d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2003524020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f2e2b7-1d35-41ee-b6e0-fad0fececb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347e052b1b3346f18f0e4e925228073b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:43Z,use_quota=True,user_id='17401dffc82341daba264e2da4caf66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86efacbe-0c8b-4963-bcbf-64a6dfb7792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86efacbe-0c8b-4963-bcbf-64a6dfb7792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2af130d-592d-4979-ada9-60df22a9ced1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2af130d-592d-4979-ada9-60df22a9ced1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f2e2b7-1d35-41ee-b6e0-fad0fececb10', 'volume_name': 'volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:43 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47977958-2e1b-4009-8e00-986f5806e7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47977958-2e1b-4009-8e00-986f5806e7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3191a376-e730-4acb-b6af-57115b0ed2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Volume 92f2e2b7-1d35-41ee-b6e0-fad0fececb10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10', 'volume_size': 1}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2e24204-c3b5-4a80-9dd7-4f53401b0661" returned: 0 in 1.161s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Lock "cinder-quobyte-f2e24204-c3b5-4a80-9dd7-4f53401b0661" released by "delete_volume" :: held 2.269s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Created reservations ['f3539e89-83d8-449a-aa42-f84c6ff2558a', 'efb3e34e-9a96-4b95-bca9-74c3019b69d2', 'f772a17d-cdca-4758-ab31-a4d3ef84746a', '7c729251-c6cb-4dd3-b6cd-ef1fb7248a71'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:43 devstack sudo[101136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:43 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Flow 'volume_create_manager' (c3d77398-ed22-4538-972b-55f7003dc9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba89824-92b7-4dfb-a6f6-6bbc80292191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba89824-92b7-4dfb-a6f6-6bbc80292191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1330601521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734c0772-6011-4bc1-896c-4df555856e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ecc197ae074e70a06b2c2084dc24c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:46Z,use_quota=True,user_id='3a26514e28c94087b3c21c955be96f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbd8b3d-99cb-4e8a-b9cc-d7e0b8e18eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbd8b3d-99cb-4e8a-b9cc-d7e0b8e18eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfc0aee-72a1-408a-adc3-8daf7399f5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfc0aee-72a1-408a-adc3-8daf7399f5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734c0772-6011-4bc1-896c-4df555856e29', 'volume_name': 'volume-734c0772-6011-4bc1-896c-4df555856e29', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4387bb32-6e98-439f-b0da-89fa66e9b429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4387bb32-6e98-439f-b0da-89fa66e9b429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d90733c-899d-4334-9e1a-c98fa8983865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:45 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Volume 734c0772-6011-4bc1-896c-4df555856e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734c0772-6011-4bc1-896c-4df555856e29', 'volume_size': 1}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:45 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 2.239s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:45 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:02:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Deleted volume successfully.
Jul 03 13:02:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-15dbe63e-aa62-4943-b4fc-dfbfab065145 tempest-VolumesTransfersTest-1763838364 None] Lock "cinder-f2e24204-c3b5-4a80-9dd7-4f53401b0661-delete_volume" released by "delete_volume" :: held 4.825s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:49 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" returned: 0 in 7.497s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:49 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f4571e-a89d-4de6-a250-ebb9f5a3eaf6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:50 devstack sudo[101146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7
Jul 03 13:02:50 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:51 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7" returned: 0 in 1.220s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7, size 1024.00 MB, duration 7.50 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:02:51 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Converted 1024.00 MB image at 136.56 MB/s
Jul 03 13:02:51 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d is being set with open permissions: ugo+rw
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:51 devstack sudo[101152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d
Jul 03 13:02:51 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:51 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" returned: 0 in 0.867s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" released by "_copy_volume_from_snapshot" :: held 12.010s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-47fc4926-f7f0-46fe-bef4-7661ca51442f-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" released by "_create_volume_from_snapshot" :: held 12.072s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.119s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.468s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2003524020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f2e2b7-1d35-41ee-b6e0-fad0fececb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347e052b1b3346f18f0e4e925228073b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:43Z,use_quota=True,user_id='17401dffc82341daba264e2da4caf66d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Creating volume 92f2e2b7-1d35-41ee-b6e0-fad0fececb10 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:02:51 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:02:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:52 devstack sudo[101155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10 1073741824
Jul 03 13:02:52 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70564849-b4f6-4db6-9350-580a2e0c79e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d', 'volume_size': 1, 'snapshot_id': '47fc4926-f7f0-46fe-bef4-7661ca51442f'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1090a96f-943b-44dd-a0b1-b3202880ec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:52 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Volume volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d (ded00cdf-89cb-4563-82a0-f0dfcebbad2d): created successfully
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1090a96f-943b-44dd-a0b1-b3202880ec33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Flow 'volume_create_manager' (f32c4da7-d908-46ad-add8-b21ed600634d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7db5eedf-a5f8-4cfc-a561-e62a53a2669c tempest-VolumeDependencyTests-471460911 None] Created volume successfully.
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Acquiring lock "cinder-47fc4926-f7f0-46fe-bef4-7661ca51442f-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-47fc4926-f7f0-46fe-bef4-7661ca51442f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Acquiring lock "cinder-quobyte-da561f49-a27c-422c-931e-65e178abb4a7" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-da561f49-a27c-422c-931e-65e178abb4a7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Acquiring lock "cinder-quobyte-47fc4926-f7f0-46fe-bef4-7661ca51442f" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-47fc4926-f7f0-46fe-bef4-7661ca51442f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Deleting offline snapshot 47fc4926-f7f0-46fe-bef4-7661ca51442f of volume da561f49-a27c-422c-931e-65e178abb4a7 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] snapshot_file for this snap is: volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3a6c32-e86c-4fc4-a292-936ee4dd4294]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:52 devstack sudo[101157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f
Jul 03 13:02:52 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:53 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10 1073741824" returned: 0 in 1.156s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:53 devstack sudo[101163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10
Jul 03 13:02:53 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:53 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f" returned: 0 in 0.998s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da561f49-a27c-422c-931e-65e178abb4a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:02:53 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9796c6-2c0d-4890-a2fb-14d556842872]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:53 devstack sudo[101168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7
Jul 03 13:02:53 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:54 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10" returned: 0 in 0.801s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.188s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1330601521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734c0772-6011-4bc1-896c-4df555856e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ecc197ae074e70a06b2c2084dc24c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:46Z,use_quota=True,user_id='3a26514e28c94087b3c21c955be96f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Creating volume 734c0772-6011-4bc1-896c-4df555856e29 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:02:54 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:54 devstack sudo[101171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29 1073741824
Jul 03 13:02:54 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3191a376-e730-4acb-b6af-57115b0ed2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9383e5c3-96fb-4438-9954-b417b69e287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Volume volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10 (92f2e2b7-1d35-41ee-b6e0-fad0fececb10): created successfully
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9383e5c3-96fb-4438-9954-b417b69e287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Flow 'volume_create_manager' (07873b16-7726-4bc2-ab3c-2c7cb20cbff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-aee6b2bd-044a-4027-bf18-a8fcb4cba097 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Created volume successfully.
Jul 03 13:02:54 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7" returned: 0 in 1.014s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:54 devstack sudo[101176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f
Jul 03 13:02:54 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:55 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29 1073741824" returned: 0 in 1.131s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:55 devstack sudo[101187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29
Jul 03 13:02:55 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:55 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f" returned: 0 in 1.030s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:55 devstack sudo[101190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f
Jul 03 13:02:55 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:56 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29" returned: 0 in 0.870s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d90733c-899d-4334-9e1a-c98fa8983865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734c0772-6011-4bc1-896c-4df555856e29', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296c5826-3012-4857-af1c-38322eab716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:56 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Volume volume-734c0772-6011-4bc1-896c-4df555856e29 (734c0772-6011-4bc1-896c-4df555856e29): created successfully
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296c5826-3012-4857-af1c-38322eab716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Flow 'volume_create_manager' (c3d77398-ed22-4538-972b-55f7003dc9ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-21657b9c-e49a-472a-b6b1-f7892cf1a50e tempest-VolumesServicesTestJSON-1397575413 None] Created volume successfully.
Jul 03 13:02:56 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7.47fc4926-f7f0-46fe-bef4-7661ca51442f" returned: 0 in 0.847s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-47fc4926-f7f0-46fe-bef4-7661ca51442f" released by "_delete_snapshot" :: held 4.079s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-da561f49-a27c-422c-931e-65e178abb4a7" released by "delete_snapshot" :: held 4.113s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Created reservations ['a2aab36d-1534-45b1-b4dc-ec19443cff27', '31ef3cb1-e68f-4ec1-ac24-2f56f2ea204a', '75ae0158-434f-493e-ac49-dc194db73b94', 'e698ad22-d934-48d5-abe0-569effa175ea'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Delete snapshot completed successfully.
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cac6da3b-b618-4a52-9df0-070f96554034 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-47fc4926-f7f0-46fe-bef4-7661ca51442f-delete_snapshot" released by "delete_snapshot" :: held 4.385s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Acquiring lock "cinder-734c0772-6011-4bc1-896c-4df555856e29-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Lock "cinder-734c0772-6011-4bc1-896c-4df555856e29-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Acquiring lock "cinder-quobyte-734c0772-6011-4bc1-896c-4df555856e29" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Lock "cinder-quobyte-734c0772-6011-4bc1-896c-4df555856e29" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de77fdd-aa39-4008-8a25-643d66803dd2]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:57 devstack sudo[101228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29
Jul 03 13:02:57 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Flow 'volume_create_manager' (4a3cafca-52e5-466d-854b-e338260bb2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738c7edf-441f-4546-93ab-d89e45a4afac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738c7edf-441f-4546-93ab-d89e45a4afac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-501966660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee255f0e-edfd-42f0-bbf7-d524440bc94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b64c680bc64e47ade7cdf61c3fc11d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:57Z,use_quota=True,user_id='6e12adead71843acba746883cd7ccdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b98780-f1e1-4ec7-80e7-613089cbec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b98780-f1e1-4ec7-80e7-613089cbec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3279245f-865c-4be5-b929-81b2a4ef3bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3279245f-865c-4be5-b929-81b2a4ef3bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee255f0e-edfd-42f0-bbf7-d524440bc94b', 'volume_name': 'volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf2e8cf-daad-4235-be69-ffdbb47af7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf2e8cf-daad-4235-be69-ffdbb47af7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18237684-618b-4da1-b373-384e7c9b1b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Volume ee255f0e-edfd-42f0-bbf7-d524440bc94b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b', 'volume_size': 1}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-501966660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee255f0e-edfd-42f0-bbf7-d524440bc94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b64c680bc64e47ade7cdf61c3fc11d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:57Z,use_quota=True,user_id='6e12adead71843acba746883cd7ccdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Creating volume ee255f0e-edfd-42f0-bbf7-d524440bc94b {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:02:57 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:57 devstack sudo[101232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b 1073741824
Jul 03 13:02:57 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Acquiring lock "cinder-da561f49-a27c-422c-931e-65e178abb4a7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-da561f49-a27c-422c-931e-65e178abb4a7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Acquiring lock "cinder-quobyte-da561f49-a27c-422c-931e-65e178abb4a7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-da561f49-a27c-422c-931e-65e178abb4a7" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b1cce7-3d9d-4a28-b295-e99f361557b0]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29" returned: 0 in 1.051s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:57 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:57 devstack sudo[101239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29
Jul 03 13:02:57 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:58 devstack sudo[101238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7
Jul 03 13:02:58 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-416cc9a0-4c8d-4d83-aa27-1e00d1906956 req-f20a9dcb-003d-4f0e-9e4c-e63e2c71b759 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:58 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b 1073741824" returned: 0 in 1.312s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:58 devstack sudo[101255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b
Jul 03 13:02:58 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:58 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-734c0772-6011-4bc1-896c-4df555856e29" returned: 0 in 0.828s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Lock "cinder-quobyte-734c0772-6011-4bc1-896c-4df555856e29" released by "delete_volume" :: held 1.942s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:58 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Created reservations ['474ccbc4-ca6b-4390-8289-f03f4f300643', '06114aa8-ca4d-46b8-811f-2c78811f0a2a', 'e060cb5d-c551-4caf-ba9f-3018e52246d5', 'dfe4b07d-3026-4f5a-a20e-ab063584f699'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:59 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7" returned: 0 in 1.133s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:59 devstack sudo[101261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:02:59 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:59 devstack sudo[101262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7
Jul 03 13:02:59 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:59 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b" returned: 0 in 0.973s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] <== create_volume: return (2356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.358s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-416cc9a0-4c8d-4d83-aa27-1e00d1906956 req-f20a9dcb-003d-4f0e-9e4c-e63e2c71b759 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.149s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18237684-618b-4da1-b373-384e7c9b1b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68e100b-1183-469f-8507-a5673d1c38a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[af417356-2469-4959-8069-7abc663e1e29]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-416cc9a0-4c8d-4d83-aa27-1e00d1906956 req-f20a9dcb-003d-4f0e-9e4c-e63e2c71b759 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:59 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Volume volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b (ee255f0e-edfd-42f0-bbf7-d524440bc94b): created successfully
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68e100b-1183-469f-8507-a5673d1c38a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Flow 'volume_create_manager' (4a3cafca-52e5-466d-854b-e338260bb2ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8507b2e8-a74e-4cf6-b349-304f8f8a3d0a tempest-VolumesTransfersV357Test-279740327 None] Created volume successfully.
Jul 03 13:02:59 devstack sudo[101266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10
Jul 03 13:02:59 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:59 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-da561f49-a27c-422c-931e-65e178abb4a7" returned: 0 in 0.897s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-da561f49-a27c-422c-931e-65e178abb4a7" released by "delete_volume" :: held 2.133s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Created reservations ['3d095055-66aa-4252-ba66-8faecd0844d4', '08c2334d-5064-45a8-9dbc-d5541bd6fe52', '1fd652df-9f96-4198-9072-93481d6fa2eb', '1b9ff07f-7549-4639-8b5e-282484488ee6'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:00 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.043s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Deleted volume successfully.
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e4340f6-c578-4fbd-9e17-356f8f086433 tempest-VolumesServicesTestJSON-1397575413 None] Lock "cinder-734c0772-6011-4bc1-896c-4df555856e29-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:00 devstack sudo[101270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:03:00 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:00 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-416cc9a0-4c8d-4d83-aa27-1e00d1906956 req-f20a9dcb-003d-4f0e-9e4c-e63e2c71b759 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10" returned: 0 in 1.252s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-416cc9a0-4c8d-4d83-aa27-1e00d1906956 req-f20a9dcb-003d-4f0e-9e4c-e63e2c71b759 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.307s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-416cc9a0-4c8d-4d83-aa27-1e00d1906956 req-f20a9dcb-003d-4f0e-9e4c-e63e2c71b759 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3db47fef-be7b-461b-bb43-746289d4b522', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:03:01 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.916s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:01 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-416cc9a0-4c8d-4d83-aa27-1e00d1906956 req-f20a9dcb-003d-4f0e-9e4c-e63e2c71b759 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] attachment_update completed successfully.
Jul 03 13:03:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Deleted volume successfully.
Jul 03 13:03:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-25a4d541-23d6-4769-a008-ad34ca827350 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-da561f49-a27c-422c-931e-65e178abb4a7-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d8c177f1-a938-4f85-89e3-96ea5b8d1540 tempest-VolumesTransfersV357Test-2092506665 None] Transfer volume completed successfully.
Jul 03 13:03:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Acquiring lock "cinder-ded00cdf-89cb-4563-82a0-f0dfcebbad2d-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-ded00cdf-89cb-4563-82a0-f0dfcebbad2d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Acquiring lock "cinder-quobyte-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[900081d0-f9ea-450d-b2de-abc6b3303b03]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:01 devstack sudo[101346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d
Jul 03 13:03:02 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Acquiring lock "cinder-ee255f0e-edfd-42f0-bbf7-d524440bc94b-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Lock "cinder-ee255f0e-edfd-42f0-bbf7-d524440bc94b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Acquiring lock "cinder-quobyte-ee255f0e-edfd-42f0-bbf7-d524440bc94b" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:03 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" returned: 0 in 1.339s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Lock "cinder-quobyte-ee255f0e-edfd-42f0-bbf7-d524440bc94b" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45c0801-7945-4d33-8e2c-76e7bc019e16]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:03 devstack sudo[101667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d
Jul 03 13:03:03 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:03 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b
Jul 03 13:03:03 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:04 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" returned: 0 in 0.838s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-quobyte-ded00cdf-89cb-4563-82a0-f0dfcebbad2d" released by "delete_volume" :: held 2.249s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Created reservations ['8cbbe1af-0add-4468-9497-7e76bddd2a4b', '27f6417c-9838-48cb-84c5-6c45c20932df', '3f977593-8b88-4cb0-aa28-1b2af7f370e3', '45bef679-c8ba-4503-b53c-dede583619ec'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:04 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b" returned: 0 in 0.954s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:04 devstack sudo[101681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b
Jul 03 13:03:04 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:04 devstack sudo[101683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:03:04 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:04 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee255f0e-edfd-42f0-bbf7-d524440bc94b" returned: 0 in 0.809s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Lock "cinder-quobyte-ee255f0e-edfd-42f0-bbf7-d524440bc94b" released by "delete_volume" :: held 1.828s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:05 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.811s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:05 devstack sudo[101687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:03:05 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:05 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Deleted volume successfully.
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a49d0c58-b919-45de-a006-2f9e6945e3b0 tempest-VolumeDependencyTests-471460911 None] Lock "cinder-ded00cdf-89cb-4563-82a0-f0dfcebbad2d-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Created reservations ['bfcf104b-c68b-4db7-9be5-f43097119f47', 'eceb0f14-2973-466d-90e2-71749fd902c6', '2506afa3-de9f-4621-bcf9-2a1e1a8dcb06', '603ab40a-1d47-4277-bbbe-1fc4cfaf330e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:05 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:03:05 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:03:06 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Flow 'volume_create_manager' (e1e8bed2-9633-4556-bdab-da67201f95f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6000ce80-496c-44b1-8006-37a79a3c31b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.229s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6000ce80-496c-44b1-8006-37a79a3c31b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-90315479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b64c680bc64e47ade7cdf61c3fc11d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:06Z,use_quota=True,user_id='6e12adead71843acba746883cd7ccdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e73dced-b14b-4225-a2e9-760d44c6138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e73dced-b14b-4225-a2e9-760d44c6138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeac14d2-afba-4c20-bfc2-c28817f5ff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeac14d2-afba-4c20-bfc2-c28817f5ff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0', 'volume_name': 'volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377cf457-6aba-46ad-833f-783c8e0bdd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377cf457-6aba-46ad-833f-783c8e0bdd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a24f2ba-3221-4988-a02f-87a63089cd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:06 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Volume 1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0', 'volume_size': 1}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-90315479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b64c680bc64e47ade7cdf61c3fc11d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:06Z,use_quota=True,user_id='6e12adead71843acba746883cd7ccdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Creating volume 1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:06 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:06 devstack sudo[101693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0 1073741824
Jul 03 13:03:06 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:06 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.142s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Deleted volume successfully.
Jul 03 13:03:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4bc819c-5fbc-4424-89dc-84e0391878ed tempest-VolumesTransfersV357Test-1690876512 None] Lock "cinder-ee255f0e-edfd-42f0-bbf7-d524440bc94b-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:07 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0 1073741824" returned: 0 in 1.353s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:07 devstack sudo[101699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0
Jul 03 13:03:07 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:08 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0" returned: 0 in 1.138s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] <== create_volume: return (2565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:03:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.568s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a24f2ba-3221-4988-a02f-87a63089cd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd68e6a-5429-4a3a-95d7-2ac0f9eed24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:08 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Volume volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0 (1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0): created successfully
Jul 03 13:03:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd68e6a-5429-4a3a-95d7-2ac0f9eed24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Flow 'volume_create_manager' (e1e8bed2-9633-4556-bdab-da67201f95f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9171f532-8d5b-408f-b1c7-c262396fb97f tempest-VolumesTransfersV357Test-279740327 None] Created volume successfully.
Jul 03 13:03:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Acquiring lock "cinder-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Lock "cinder-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Acquiring lock "cinder-quobyte-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Lock "cinder-quobyte-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe247fe0-01da-47c0-832c-af5b9e22864c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:10 devstack sudo[101704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0
Jul 03 13:03:10 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-93a11f21-d54f-4669-beda-75e191e17d63 req-c999add9-ad61-479b-a7ea-2ef59b5965de tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Terminate volume connection completed successfully.
Jul 03 13:03:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-93a11f21-d54f-4669-beda-75e191e17d63 req-c999add9-ad61-479b-a7ea-2ef59b5965de tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Deleting attachment 3db47fef-be7b-461b-bb43-746289d4b522. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:03:11 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0" returned: 0 in 1.111s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:11 devstack sudo[101738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0
Jul 03 13:03:11 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:12 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0" returned: 0 in 0.917s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Lock "cinder-quobyte-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0" released by "delete_volume" :: held 2.080s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:12 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Created reservations ['8fc5a4d4-c101-41ca-b4e2-c93327b983aa', 'e9668166-e926-40d9-9087-bf55ebbc4ee6', '7f796b5b-b654-4475-80f0-9db7b46a175f', '5d8bec99-f210-4e0a-b184-56d1eec4336b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:12 devstack sudo[101741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:03:12 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Acquiring lock "cinder-92f2e2b7-1d35-41ee-b6e0-fad0fececb10-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "cinder-92f2e2b7-1d35-41ee-b6e0-fad0fececb10-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:13 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.916s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:13 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Deleted volume successfully.
Jul 03 13:03:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Acquiring lock "cinder-quobyte-92f2e2b7-1d35-41ee-b6e0-fad0fececb10" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4b206a45-fa63-4e94-b375-f26c7998a56f tempest-VolumesTransfersV357Test-1690876512 None] Lock "cinder-1298e6eb-6324-4d7d-a6ee-b82ec5ddddd0-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "cinder-quobyte-92f2e2b7-1d35-41ee-b6e0-fad0fececb10" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[68928cdc-c28e-4eaa-a90b-c240817c8c1a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:13 devstack sudo[101744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10
Jul 03 13:03:13 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:14 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:03:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Flow 'volume_create_manager' (e8bdd2b0-d9b0-493a-abb3-b8c33e44ef8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f219174-7185-4d76-ae9f-4b0181e6d8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f219174-7185-4d76-ae9f-4b0181e6d8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace03747-d755-41f4-b4ab-29698d361d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079ba94d6e34dbca265f748f1c5fd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:14Z,use_quota=True,user_id='2b7aa56516514a61996f6568ebbd2585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf93007-70c8-483d-8ce1-8592a491e879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf93007-70c8-483d-8ce1-8592a491e879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ff49ff-ccb7-4657-95b6-2a9ae175e8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:14 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:03:14 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10" returned: 0 in 1.337s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:14 devstack sudo[101749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10
Jul 03 13:03:14 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ff49ff-ccb7-4657-95b6-2a9ae175e8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ace03747-d755-41f4-b4ab-29698d361d15', 'volume_name': 'volume-ace03747-d755-41f4-b4ab-29698d361d15', 'volume_size': 1, 'image_id': '88ce3de5-5d60-4893-95ae-e0fb12569518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88ce3de5-5d60-4893-95ae-e0fb12569518', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54a999812e78703ac22c9b660e63c593', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f079ba94d6e34dbca265f748f1c5fd60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16668082bccd36b619b02dfaa9b144a33aaee9683788af406741916378e77f8cc4bdcb86d07d85c94d065687509c57e08bdd51911438e50430de7cd9d2ecaf46', 'id': '88ce3de5-5d60-4893-95ae-e0fb12569518', 'created_at': datetime.datetime(2026, 7, 3, 11, 3, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 3, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88ce3de5-5d60-4893-95ae-e0fb12569518/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b62f6510>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6a687c-bf55-49a6-8acd-859394dfd437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6a687c-bf55-49a6-8acd-859394dfd437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766a0294-6c07-4683-8e0d-9be009582117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:15 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Volume ace03747-d755-41f4-b4ab-29698d361d15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ace03747-d755-41f4-b4ab-29698d361d15', 'volume_size': 1, 'image_id': '88ce3de5-5d60-4893-95ae-e0fb12569518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88ce3de5-5d60-4893-95ae-e0fb12569518', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54a999812e78703ac22c9b660e63c593', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f079ba94d6e34dbca265f748f1c5fd60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16668082bccd36b619b02dfaa9b144a33aaee9683788af406741916378e77f8cc4bdcb86d07d85c94d065687509c57e08bdd51911438e50430de7cd9d2ecaf46', 'id': '88ce3de5-5d60-4893-95ae-e0fb12569518', 'created_at': datetime.datetime(2026, 7, 3, 11, 3, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 3, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88ce3de5-5d60-4893-95ae-e0fb12569518/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b62f6510>}
Jul 03 13:03:15 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Trying to clone ace03747-d755-41f4-b4ab-29698d361d15 from image 88ce3de5-5d60-4893-95ae-e0fb12569518 at location (None, [{'url': 'file:///opt/stack/data/glance/images/88ce3de5-5d60-4893-95ae-e0fb12569518', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jul 03 13:03:15 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jul 03 13:03:15 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 13:03:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab2d159-64e3-46d7-90ae-0f7a2b4cc3e5]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:15 devstack sudo[101751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD
Jul 03 13:03:15 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:15 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-92f2e2b7-1d35-41ee-b6e0-fad0fececb10" returned: 0 in 0.988s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "cinder-quobyte-92f2e2b7-1d35-41ee-b6e0-fad0fececb10" released by "delete_volume" :: held 2.403s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:16 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Created reservations ['9799ad66-5417-4eef-b0bf-045e5e56c833', 'cfbe5023-ef21-451c-b5de-9ada64eb47c9', '344caed1-bc0f-4cf5-a292-9bd0120dff49', '19534dd7-f022-4065-8d56-5cd71d2e0659'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:16 devstack sudo[101754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:03:16 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:16 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD" returned: 0 in 1.027s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:16 devstack sudo[101758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD
Jul 03 13:03:16 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:17 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.042s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:17 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Deleted volume successfully.
Jul 03 13:03:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2122ba3-4fa3-41fc-84df-a0e1af0878c1 tempest-TestServerVolumeAttachScenarioOldVersion-937652672 None] Lock "cinder-92f2e2b7-1d35-41ee-b6e0-fad0fececb10-delete_volume" released by "delete_volume" :: held 3.837s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:17 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD" returned: 1 in 1.302s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:03:17 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Temporary image 88ce3de5-5d60-4893-95ae-e0fb12569518 is fetched for user 2b7aa56516514a61996f6568ebbd2585. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jul 03 13:03:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e03687-e180-491b-8e24-795bb8efef89]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:18 devstack sudo[101765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD
Jul 03 13:03:18 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Flow 'volume_create_manager' (33e39a12-6782-4ec7-aad4-67c507c4538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c750af1-5b4e-4a67-b78f-8a5dcb2b5b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c750af1-5b4e-4a67-b78f-8a5dcb2b5b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-569292142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b63d718-f3b3-44af-987d-9b694d0221d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f7b7bdc48048a8ad812d6d594f79b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:19Z,use_quota=True,user_id='400de003892248b9910d80e25da8fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8b7149-975f-4f1b-babb-c3ba9399276e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8b7149-975f-4f1b-babb-c3ba9399276e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4897f9e-f466-442a-8fce-076088d315b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:19 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4897f9e-f466-442a-8fce-076088d315b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b63d718-f3b3-44af-987d-9b694d0221d6', 'volume_name': 'volume-7b63d718-f3b3-44af-987d-9b694d0221d6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6127e82-2c93-43a9-a31f-7a83ee7fc4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6127e82-2c93-43a9-a31f-7a83ee7fc4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8f1b6d-0f6a-49a4-847b-3268dee1604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:19 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Volume 7b63d718-f3b3-44af-987d-9b694d0221d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b63d718-f3b3-44af-987d-9b694d0221d6', 'volume_size': 1}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-569292142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b63d718-f3b3-44af-987d-9b694d0221d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f7b7bdc48048a8ad812d6d594f79b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:19Z,use_quota=True,user_id='400de003892248b9910d80e25da8fdf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Creating volume 7b63d718-f3b3-44af-987d-9b694d0221d6 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:19 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD" returned: 0 in 1.537s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:19 devstack sudo[101808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6 1073741824
Jul 03 13:03:19 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:19 devstack sudo[101809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD
Jul 03 13:03:19 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:20 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD" returned: 1 in 1.127s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:03:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:21 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6 1073741824" returned: 0 in 1.546s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:21 devstack sudo[101822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6
Jul 03 13:03:21 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:21 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6" returned: 0 in 0.775s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] <== create_volume: return (2386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.216s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace03747-d755-41f4-b4ab-29698d361d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079ba94d6e34dbca265f748f1c5fd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:14Z,use_quota=True,user_id='2b7aa56516514a61996f6568ebbd2585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Creating volume ace03747-d755-41f4-b4ab-29698d361d15 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:21 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:03:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:22 devstack sudo[101825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 1073741824
Jul 03 13:03:22 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8f1b6d-0f6a-49a4-847b-3268dee1604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b63d718-f3b3-44af-987d-9b694d0221d6', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9835f61c-84a2-49a9-a9ce-df8f503a9067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:22 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Volume volume-7b63d718-f3b3-44af-987d-9b694d0221d6 (7b63d718-f3b3-44af-987d-9b694d0221d6): created successfully
Jul 03 13:03:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9835f61c-84a2-49a9-a9ce-df8f503a9067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Flow 'volume_create_manager' (33e39a12-6782-4ec7-aad4-67c507c4538c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f7ea4067-9f19-4ef8-93f4-acdf762f669d tempest-AbsoluteLimitsTests-1092994027 None] Created volume successfully.
Jul 03 13:03:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Acquiring lock "cinder-7b63d718-f3b3-44af-987d-9b694d0221d6-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Lock "cinder-7b63d718-f3b3-44af-987d-9b694d0221d6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Acquiring lock "cinder-quobyte-7b63d718-f3b3-44af-987d-9b694d0221d6" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Lock "cinder-quobyte-7b63d718-f3b3-44af-987d-9b694d0221d6" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[633d9c82-7cf5-456f-8066-07cf66997843]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:23 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 1073741824" returned: 0 in 1.136s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:23 devstack sudo[101831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6
Jul 03 13:03:23 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:23 devstack sudo[101832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15
Jul 03 13:03:23 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Flow 'volume_create_manager' (cf2c9c94-1d1f-453f-9c02-1dd59d6c3c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659630c9-25ca-4fa5-bfbc-3dc1ce50a11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659630c9-25ca-4fa5-bfbc-3dc1ce50a11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1922863928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072f0e4d-3d05-4d1a-9e98-9f65c6fe8071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38eb4f953ed43f0aa3a2b6bac106f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:23Z,use_quota=True,user_id='915722d7473d4baaae6bef0747209a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585ed6d9-8d88-422c-8314-7e34b0fbadeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585ed6d9-8d88-422c-8314-7e34b0fbadeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03db7aec-074a-4613-a98a-3ef15eda1726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03db7aec-074a-4613-a98a-3ef15eda1726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '072f0e4d-3d05-4d1a-9e98-9f65c6fe8071', 'volume_name': 'volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071', 'volume_size': 2}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60807a0d-4b90-44fe-9806-e38c0ad46e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60807a0d-4b90-44fe-9806-e38c0ad46e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0b1b1f-db59-49c7-9792-37f10fab2d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Volume 072f0e4d-3d05-4d1a-9e98-9f65c6fe8071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071', 'volume_size': 2}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:23 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6" returned: 0 in 0.906s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:23 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15" returned: 0 in 0.813s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:03:23 devstack sudo[101839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6
Jul 03 13:03:23 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1922863928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072f0e4d-3d05-4d1a-9e98-9f65c6fe8071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38eb4f953ed43f0aa3a2b6bac106f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:23Z,use_quota=True,user_id='915722d7473d4baaae6bef0747209a6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Creating volume 072f0e4d-3d05-4d1a-9e98-9f65c6fe8071 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:24 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:03:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071 2147483648 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:24 devstack sudo[101841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071 2147483648
Jul 03 13:03:24 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:24 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Attempting download of 88ce3de5-5d60-4893-95ae-e0fb12569518 ((None, [{'url': 'file:///opt/stack/data/glance/images/88ce3de5-5d60-4893-95ae-e0fb12569518', 'metadata': {}}])) to volume ace03747-d755-41f4-b4ab-29698d361d15. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jul 03 13:03:24 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[35db8aed-501a-45b9-a73f-8dc2da64670b]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88ce3de5-5d60-4893-95ae-e0fb12569518_rrez_92l {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:24 devstack sudo[101843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88ce3de5-5d60-4893-95ae-e0fb12569518_rrez_92l
Jul 03 13:03:24 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:24 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7b63d718-f3b3-44af-987d-9b694d0221d6" returned: 0 in 0.818s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Lock "cinder-quobyte-7b63d718-f3b3-44af-987d-9b694d0221d6" released by "delete_volume" :: held 1.776s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Created reservations ['77b442cb-7142-45a9-bac3-73f8c1fd53a6', '22a1dc90-6652-48ec-954d-ec84c08c6c29', '1a328509-f505-44ab-94fc-47b760b28a99', '9d024b9c-1793-4b32-897d-100bc26000b0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:25 devstack sudo[101849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:03:25 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:25 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88ce3de5-5d60-4893-95ae-e0fb12569518_rrez_92l" returned: 0 in 1.108s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88ce3de5-5d60-4893-95ae-e0fb12569518_rrez_92l {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:25 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071 2147483648" returned: 0 in 1.393s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:25 devstack sudo[101854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88ce3de5-5d60-4893-95ae-e0fb12569518_rrez_92l
Jul 03 13:03:25 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:25 devstack sudo[101856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071
Jul 03 13:03:25 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:26 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.124s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Deleted volume successfully.
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1c5208cc-75c4-4cc3-8d66-7d311b905e8e tempest-AbsoluteLimitsTests-1092994027 None] Lock "cinder-7b63d718-f3b3-44af-987d-9b694d0221d6-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:26 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071" returned: 0 in 1.168s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] <== create_volume: return (2659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.666s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:26 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88ce3de5-5d60-4893-95ae-e0fb12569518_rrez_92l" returned: 1 in 1.415s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88ce3de5-5d60-4893-95ae-e0fb12569518_rrez_92l' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f157d7f-f0f9-4c36-9182-762874d0c4d3]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0b1b1f-db59-49c7-9792-37f10fab2d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071', 'volume_size': 2}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf8551f-9d5f-4fa3-9713-daa5a43d9e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Volume volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071 (072f0e4d-3d05-4d1a-9e98-9f65c6fe8071): created successfully
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf8551f-9d5f-4fa3-9713-daa5a43d9e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Flow 'volume_create_manager' (cf2c9c94-1d1f-453f-9c02-1dd59d6c3c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-19645530-5dae-40e4-b3f0-a9c50cea206a tempest-VolumesCloneNegativeTest-1847820355 None] Created volume successfully.
Jul 03 13:03:26 devstack sudo[101862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD
Jul 03 13:03:26 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:27 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD" returned: 0 in 1.162s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Acquiring lock "cinder-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Lock "cinder-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Acquiring lock "cinder-quobyte-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:28 devstack sudo[101866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD
Jul 03 13:03:28 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Lock "cinder-quobyte-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071" acquired by "delete_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c47997c-b9c3-4698-b9ba-9255224d1606]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:28 devstack sudo[101868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071
Jul 03 13:03:28 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:29 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD" returned: 1 in 1.386s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:03:29 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] 88ce3de5-5d60-4893-95ae-e0fb12569518 was raw, converting to raw {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jul 03 13:03:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:29 devstack sudo[101877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15
Jul 03 13:03:29 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:29 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071" returned: 0 in 1.182s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:29 devstack sudo[101879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071
Jul 03 13:03:29 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:30 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071" returned: 0 in 1.099s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Lock "cinder-quobyte-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071" released by "delete_volume" :: held 2.360s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:30 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15" returned: 0 in 1.241s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_88ce3de5-5d60-4893-95ae-e0fb12569518_kh1h8_zwdevstack@QuobyteHD, size 0.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:03:30 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:30 devstack sudo[101886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 1G
Jul 03 13:03:30 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Created reservations ['14aa7882-1c1e-4ea1-9a25-1a0af39a3654', '39ce1eac-682d-4138-9170-3f6b3011de42', '8a4a99c7-20f3-4e6a-9f77-22711be37f39', '5cff8849-6bea-493e-acef-3201fb8f63be'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:30 devstack sudo[101888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:03:30 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:31 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 1G" returned: 0 in 1.157s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bce1254-4c4c-4cc9-a147-45271ad0d482]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:31 devstack sudo[101893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15
Jul 03 13:03:31 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.120s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:32 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:32 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Deleted volume successfully.
Jul 03 13:03:32 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=87,cinder:INSERT=29,cinder:UPDATE=114,cinder:DELETE=9 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:03:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dac45654-f9c7-43a1-84ab-c7c2ec25f4ed tempest-VolumesCloneNegativeTest-1847820355 None] Lock "cinder-072f0e4d-3d05-4d1a-9e98-9f65c6fe8071-delete_volume" released by "delete_volume" :: held 4.132s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:33 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15" returned: 0 in 1.525s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Flow 'volume_create_manager' (f7d9c2fc-a5ce-4309-8348-cd6903f49202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb35516-814c-4cdc-975f-722c277aa085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb35516-814c-4cdc-975f-722c277aa085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1102528304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84a89ea-ab42-46be-b42c-bb2346cecfa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9153792b0b45d58245258f2ed18f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:33Z,use_quota=True,user_id='e07dd503fd3d4ac0948b107a87ab76ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd75643-29fa-490b-9461-71dedef345cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd75643-29fa-490b-9461-71dedef345cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162550ef-7a2b-463f-b497-00935754e8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:33 devstack sudo[101899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15
Jul 03 13:03:33 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162550ef-7a2b-463f-b497-00935754e8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84a89ea-ab42-46be-b42c-bb2346cecfa7', 'volume_name': 'volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e7c470-8a28-4917-a7fa-5db41b81bc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e7c470-8a28-4917-a7fa-5db41b81bc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6317c016-5116-49f1-a165-cb048bc27a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:33 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Volume d84a89ea-ab42-46be-b42c-bb2346cecfa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7', 'volume_size': 1}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1102528304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84a89ea-ab42-46be-b42c-bb2346cecfa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9153792b0b45d58245258f2ed18f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:33Z,use_quota=True,user_id='e07dd503fd3d4ac0948b107a87ab76ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Creating volume d84a89ea-ab42-46be-b42c-bb2346cecfa7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:33 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:03:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:33 devstack sudo[101901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 1073741824
Jul 03 13:03:33 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:34 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15" returned: 1 in 1.169s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Downloaded image 88ce3de5-5d60-4893-95ae-e0fb12569518 ((None, [{'url': 'file:///opt/stack/data/glance/images/88ce3de5-5d60-4893-95ae-e0fb12569518', 'metadata': {}}])) to volume ace03747-d755-41f4-b4ab-29698d361d15 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Temporary image 88ce3de5-5d60-4893-95ae-e0fb12569518 for user 2b7aa56516514a61996f6568ebbd2585 is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Marking volume ace03747-d755-41f4-b4ab-29698d361d15 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Copying metadata from image 88ce3de5-5d60-4893-95ae-e0fb12569518 to ace03747-d755-41f4-b4ab-29698d361d15. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Creating volume glance metadata for volume ace03747-d755-41f4-b4ab-29698d361d15 backed by image 88ce3de5-5d60-4893-95ae-e0fb12569518 with: {'image_id': '88ce3de5-5d60-4893-95ae-e0fb12569518', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '54a999812e78703ac22c9b660e63c593', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=86,cinder:UPDATE=113,cinder:INSERT=25,cinder:DELETE=10 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766a0294-6c07-4683-8e0d-9be009582117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace03747-d755-41f4-b4ab-29698d361d15', 'volume_size': 1, 'image_id': '88ce3de5-5d60-4893-95ae-e0fb12569518', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88ce3de5-5d60-4893-95ae-e0fb12569518', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54a999812e78703ac22c9b660e63c593', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f079ba94d6e34dbca265f748f1c5fd60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16668082bccd36b619b02dfaa9b144a33aaee9683788af406741916378e77f8cc4bdcb86d07d85c94d065687509c57e08bdd51911438e50430de7cd9d2ecaf46', 'id': '88ce3de5-5d60-4893-95ae-e0fb12569518', 'created_at': datetime.datetime(2026, 7, 3, 11, 3, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 3, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88ce3de5-5d60-4893-95ae-e0fb12569518/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b62f6510>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acbc7c8-e73c-424e-9deb-32b2c655056f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Volume volume-ace03747-d755-41f4-b4ab-29698d361d15 (ace03747-d755-41f4-b4ab-29698d361d15): created successfully
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acbc7c8-e73c-424e-9deb-32b2c655056f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Flow 'volume_create_manager' (e8bdd2b0-d9b0-493a-abb3-b8c33e44ef8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0da3657e-cba3-4015-b5a2-32baa79b0cf3 tempest-VolumeImageDependencyTests-1848334000 None] Created volume successfully.
Jul 03 13:03:34 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 1073741824" returned: 0 in 1.271s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:34 devstack sudo[101910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7
Jul 03 13:03:34 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:35 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7" returned: 0 in 0.794s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6317c016-5116-49f1-a165-cb048bc27a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af22d5e3-ae91-4636-99bb-f6c2711a8ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Volume volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 (d84a89ea-ab42-46be-b42c-bb2346cecfa7): created successfully
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af22d5e3-ae91-4636-99bb-f6c2711a8ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Flow 'volume_create_manager' (f7d9c2fc-a5ce-4309-8348-cd6903f49202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-836ede9d-13c6-4b48-9557-a9ad4b74fcf5 tempest-VolumesDeleteCascade-600258318 None] Created volume successfully.
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Acquiring lock "cinder-ace03747-d755-41f4-b4ab-29698d361d15-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Lock "cinder-ace03747-d755-41f4-b4ab-29698d361d15-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Acquiring lock "cinder-quobyte-ace03747-d755-41f4-b4ab-29698d361d15" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Lock "cinder-quobyte-ace03747-d755-41f4-b4ab-29698d361d15" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc40a92-61b8-4150-ad17-49443b478296]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:36 devstack sudo[101914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15
Jul 03 13:03:36 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (577923b2-9129-4549-8a7e-b2101e7cb8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6a7414-d494-4cd0-a3fb-353745f24886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6a7414-d494-4cd0-a3fb-353745f24886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1528945273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789fddfc-5f61-4c4d-830b-294b754d8421,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:36Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d62fb4a-3bb1-4524-9783-26f71d3e5410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d62fb4a-3bb1-4524-9783-26f71d3e5410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1d71a8-6609-4276-86b7-e4cfc98b7292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1d71a8-6609-4276-86b7-e4cfc98b7292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '789fddfc-5f61-4c4d-830b-294b754d8421', 'volume_name': 'volume-789fddfc-5f61-4c4d-830b-294b754d8421', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a583a10d-e9b1-4709-976e-19225d907bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a583a10d-e9b1-4709-976e-19225d907bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dadef9-ae56-4c97-a20f-54eac5f0a57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:36 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Volume 789fddfc-5f61-4c4d-830b-294b754d8421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-789fddfc-5f61-4c4d-830b-294b754d8421', 'volume_size': 1}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1528945273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789fddfc-5f61-4c4d-830b-294b754d8421,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:36Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Creating volume 789fddfc-5f61-4c4d-830b-294b754d8421 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:36 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:36 devstack sudo[101916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421 1073741824
Jul 03 13:03:36 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:37 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15" returned: 0 in 1.413s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:37 devstack sudo[101923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15
Jul 03 13:03:37 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:37 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421 1073741824" returned: 0 in 1.422s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:37 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421
Jul 03 13:03:37 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:38 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15" returned: 1 in 1.110s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:38 devstack sudo[101932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15
Jul 03 13:03:38 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:38 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421" returned: 0 in 0.947s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] <== create_volume: return (2432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.438s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.758s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] Creating offline snapshot 359597cc-6298-48e6-9b32-966233997f0c of volume d84a89ea-ab42-46be-b42c-bb2346cecfa7 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dadef9-ae56-4c97-a20f-54eac5f0a57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789fddfc-5f61-4c4d-830b-294b754d8421', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb3b3de-5576-4120-bdda-9fa27ef2d700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[301d86df-ddcd-4621-b051-a0a321ff64ae]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Volume volume-789fddfc-5f61-4c4d-830b-294b754d8421 (789fddfc-5f61-4c4d-830b-294b754d8421): created successfully
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb3b3de-5576-4120-bdda-9fa27ef2d700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (577923b2-9129-4549-8a7e-b2101e7cb8fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e48b1064-9aa8-4cea-acea-6a1485ba3d19 tempest-VolumesGetTest-1222645544 None] Created volume successfully.
Jul 03 13:03:38 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7
Jul 03 13:03:38 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:39 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ace03747-d755-41f4-b4ab-29698d361d15" returned: 0 in 0.936s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Lock "cinder-quobyte-ace03747-d755-41f4-b4ab-29698d361d15" released by "delete_volume" :: held 3.567s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Created reservations ['c4fcbbec-47c0-4357-b5d6-a723b189f2b0', 'c7efdb80-64db-40d0-a0a9-6047b919b0f8', 'c55c3c19-0d14-44c8-bd21-7478531d149b', '21f84212-e544-45ff-9866-7fa04cf510ed'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:39 devstack sudo[101939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:03:39 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:40 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7" returned: 0 in 1.298s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:40 devstack sudo[101944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c 1G
Jul 03 13:03:40 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (68f7ce6f-5e24-43ca-b810-da7b16ba148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e659f372-75e5-4ed0-a18d-7014a46e2006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e659f372-75e5-4ed0-a18d-7014a46e2006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2052617674',display_name='tempest-VolumesGetTest-Volume-222878926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141ec589-b059-4a1c-bf29-770e44d94112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:41Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29e5c2a-0e9b-4a94-8214-21adab67d3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29e5c2a-0e9b-4a94-8214-21adab67d3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81933300-567d-48c4-b1f2-640960ccde28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81933300-567d-48c4-b1f2-640960ccde28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141ec589-b059-4a1c-bf29-770e44d94112', 'volume_name': 'volume-141ec589-b059-4a1c-bf29-770e44d94112', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71622135-dda3-4857-b8b9-ac4bf5730b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71622135-dda3-4857-b8b9-ac4bf5730b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f940c8d-76a5-4db2-a6db-46e1e0b87f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:40 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Volume 141ec589-b059-4a1c-bf29-770e44d94112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141ec589-b059-4a1c-bf29-770e44d94112', 'volume_size': 1}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:40 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.150s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Deleted volume successfully.
Jul 03 13:03:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cca042b9-5c0f-487e-a671-197c156de12c tempest-VolumeImageDependencyTests-1848334000 None] Lock "cinder-ace03747-d755-41f4-b4ab-29698d361d15-delete_volume" released by "delete_volume" :: held 5.115s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:41 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c 1G" returned: 0 in 1.382s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:41 devstack sudo[101952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c
Jul 03 13:03:41 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:42 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c" returned: 0 in 0.901s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:42 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c is being set with open permissions: ugo+rw
Jul 03 13:03:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:42 devstack sudo[101962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c
Jul 03 13:03:42 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:43 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c" returned: 0 in 0.818s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:43 devstack sudo[101967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.info
Jul 03 13:03:43 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (91bac27b-4902-4888-b6a8-8f6f6b17612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed7a2ef-0937-44bb-b2a1-3d3080ec1e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed7a2ef-0937-44bb-b2a1-3d3080ec1e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-888977183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc19fc2-9c84-442b-9331-cf72d0f82939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:43Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b777bd-8817-412b-9666-d693373cf261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b777bd-8817-412b-9666-d693373cf261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2600399f-097e-46f2-8366-c436bb20c532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2600399f-097e-46f2-8366-c436bb20c532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc19fc2-9c84-442b-9331-cf72d0f82939', 'volume_name': 'volume-4cc19fc2-9c84-442b-9331-cf72d0f82939', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b431ded3-e55e-41cb-8279-63c525517938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b431ded3-e55e-41cb-8279-63c525517938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadbb978-02fe-4e58-afaf-545272393752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume 4cc19fc2-9c84-442b-9331-cf72d0f82939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc19fc2-9c84-442b-9331-cf72d0f82939', 'volume_size': 1}
Jul 03 13:03:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:44 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.info" returned: 0 in 0.828s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:44 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.info is being set with open permissions: ugo+rw
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:44 devstack sudo[101970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.info
Jul 03 13:03:44 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:44 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.info" returned: 0 in 0.802s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.166s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.054s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2052617674',display_name='tempest-VolumesGetTest-Volume-222878926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141ec589-b059-4a1c-bf29-770e44d94112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:41Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Creating volume 141ec589-b059-4a1c-bf29-770e44d94112 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:44 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:03:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:44 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112 1073741824
Jul 03 13:03:44 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-670daf2d-c81b-4e3b-b4f8-d9769a42b655 tempest-VolumesDeleteCascade-600258318 None] Create snapshot completed successfully
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Flow 'volume_create_manager' (4412af3b-cb5b-45e0-98d3-7c8ddd1ce703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3bfbfa0-0e26-4205-a4d5-e55875238b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3bfbfa0-0e26-4205-a4d5-e55875238b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495190ef-b41d-46fd-a7a6-234b60554b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d3318bdd34e958672d07849004dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:45Z,use_quota=True,user_id='60de11af8b1e48aab3f514ca7dee655d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fe0ba0-9249-4a32-8875-d429a8ddfe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fe0ba0-9249-4a32-8875-d429a8ddfe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4f78a4-9e4c-463f-a99b-b43f90cd88dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4f78a4-9e4c-463f-a99b-b43f90cd88dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '495190ef-b41d-46fd-a7a6-234b60554b93', 'volume_name': 'volume-495190ef-b41d-46fd-a7a6-234b60554b93', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520ac6eb-5f20-4aea-8b4a-2f3c16a0d500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520ac6eb-5f20-4aea-8b4a-2f3c16a0d500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3966b43-25ef-42c6-a9e6-c46b3f66d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:45 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Volume 495190ef-b41d-46fd-a7a6-234b60554b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-495190ef-b41d-46fd-a7a6-234b60554b93', 'volume_size': 1}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:45 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112 1073741824" returned: 0 in 1.003s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:45 devstack sudo[101978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112
Jul 03 13:03:45 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:46 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112" returned: 0 in 0.744s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.988s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-888977183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc19fc2-9c84-442b-9331-cf72d0f82939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:43Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Creating volume 4cc19fc2-9c84-442b-9331-cf72d0f82939 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:46 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f940c8d-76a5-4db2-a6db-46e1e0b87f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141ec589-b059-4a1c-bf29-770e44d94112', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e19c642-5a59-4f47-8ffa-cfdd3ca63ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:46 devstack sudo[101981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 1073741824
Jul 03 13:03:46 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Volume volume-141ec589-b059-4a1c-bf29-770e44d94112 (141ec589-b059-4a1c-bf29-770e44d94112): created successfully
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e19c642-5a59-4f47-8ffa-cfdd3ca63ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (68f7ce6f-5e24-43ca-b810-da7b16ba148e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-07540a74-6353-4c39-abc6-4de20ec48c11 tempest-VolumesGetTest-1222645544 None] Created volume successfully.
Jul 03 13:03:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-141ec589-b059-4a1c-bf29-770e44d94112-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Lock "cinder-141ec589-b059-4a1c-bf29-770e44d94112-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-quobyte-141ec589-b059-4a1c-bf29-770e44d94112" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-141ec589-b059-4a1c-bf29-770e44d94112" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:47 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c91ee09-e20b-40cd-a071-442a4aaff72f]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:47 devstack sudo[101986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112
Jul 03 13:03:47 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:47 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 1073741824" returned: 0 in 1.056s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:47 devstack sudo[101989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939
Jul 03 13:03:47 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:48 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112" returned: 0 in 0.823s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:48 devstack sudo[101994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112
Jul 03 13:03:48 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:48 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939" returned: 0 in 0.778s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.215s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495190ef-b41d-46fd-a7a6-234b60554b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d3318bdd34e958672d07849004dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:45Z,use_quota=True,user_id='60de11af8b1e48aab3f514ca7dee655d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Creating volume 495190ef-b41d-46fd-a7a6-234b60554b93 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:48 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:48 devstack sudo[101997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93 1073741824
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadbb978-02fe-4e58-afaf-545272393752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc19fc2-9c84-442b-9331-cf72d0f82939', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:48 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b98097-6b3b-4c84-8b62-bef134a71f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:48 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 (4cc19fc2-9c84-442b-9331-cf72d0f82939): created successfully
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b98097-6b3b-4c84-8b62-bef134a71f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (91bac27b-4902-4888-b6a8-8f6f6b17612d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-532094a9-76c8-477b-9689-f5527f23a435 tempest-CreateVolumesFromSnapshotTest-899081313 None] Created volume successfully.
Jul 03 13:03:49 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-141ec589-b059-4a1c-bf29-770e44d94112" returned: 0 in 0.783s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-141ec589-b059-4a1c-bf29-770e44d94112" released by "delete_volume" :: held 1.677s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Created reservations ['4933dce2-07c4-4931-91c5-d16e11041acc', '6125cb43-6b5e-4e12-969a-568531e5a061', '14f8439d-9650-4145-acc2-c6d45bd44085', '49cb8a40-c621-499e-9b4b-e8f551f627db'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:49 devstack sudo[102000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:03:49 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-789fddfc-5f61-4c4d-830b-294b754d8421-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:49 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93 1073741824" returned: 0 in 1.082s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Lock "cinder-789fddfc-5f61-4c4d-830b-294b754d8421-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-quobyte-789fddfc-5f61-4c4d-830b-294b754d8421" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:49 devstack sudo[102005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93
Jul 03 13:03:49 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-789fddfc-5f61-4c4d-830b-294b754d8421" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6960444e-1368-4d56-860b-f0871889c2ed]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:49 devstack sudo[102007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421
Jul 03 13:03:49 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:50 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.800s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Deleted volume successfully.
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c0a52cac-ead9-44f4-9a41-f503df7bfe97 tempest-VolumesGetTest-1222645544 None] Lock "cinder-141ec589-b059-4a1c-bf29-770e44d94112-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:50 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93" returned: 0 in 0.835s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.023s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] Creating offline snapshot 1bddae8f-f772-4e40-9fdd-930b19178873 of volume d84a89ea-ab42-46be-b42c-bb2346cecfa7 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3966b43-25ef-42c6-a9e6-c46b3f66d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495190ef-b41d-46fd-a7a6-234b60554b93', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8c58a8-90df-4620-bf91-ed02f2e651cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75efd1d-cfce-448f-9879-c08058d531df]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:50 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Volume volume-495190ef-b41d-46fd-a7a6-234b60554b93 (495190ef-b41d-46fd-a7a6-234b60554b93): created successfully
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8c58a8-90df-4620-bf91-ed02f2e651cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Flow 'volume_create_manager' (4412af3b-cb5b-45e0-98d3-7c8ddd1ce703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-edb85d01-624c-44ef-9dcd-e18f6782658e tempest-CinderUnicodeTest-216483861 None] Created volume successfully.
Jul 03 13:03:50 devstack sudo[102014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c
Jul 03 13:03:50 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:50 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421" returned: 0 in 1.088s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:50 devstack sudo[102017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421
Jul 03 13:03:50 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:51 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c" returned: 0 in 0.989s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:03:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:51 devstack sudo[102023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873 1G
Jul 03 13:03:51 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:51 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-789fddfc-5f61-4c4d-830b-294b754d8421" returned: 0 in 0.896s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-789fddfc-5f61-4c4d-830b-294b754d8421" released by "delete_volume" :: held 2.047s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:51 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Created reservations ['b69422f6-08bf-431a-b9c3-725d8bd32446', '513883d3-6d2e-412c-84b7-17b534ac4ae6', '2dcae50d-6b9a-4b31-b573-9d6fb24fc3e1', '2557f2fa-2209-4113-8d20-7abd7ec59c2b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:52 devstack sudo[102025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:03:52 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Flow 'volume_create_manager' (4055b4e1-52b0-4d0a-9c38-ac7d369163fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11b2e53-d6a4-4d8c-9764-dfed0993c6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11b2e53-d6a4-4d8c-9764-dfed0993c6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-55484739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c6010c-ef4c-4885-adef-cf9bd37f1b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d3318bdd34e958672d07849004dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:52Z,use_quota=True,user_id='60de11af8b1e48aab3f514ca7dee655d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6afe1c-83d6-4d9b-8c80-71c80e79483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6afe1c-83d6-4d9b-8c80-71c80e79483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c780a7d-d201-4c1d-a077-e0c226cad5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c780a7d-d201-4c1d-a077-e0c226cad5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5c6010c-ef4c-4885-adef-cf9bd37f1b8c', 'volume_name': 'volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838e6a96-7472-456b-a586-3b87f146c0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838e6a96-7472-456b-a586-3b87f146c0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac13a0e-b18d-47ef-86ab-0db45f0c20cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:52 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Volume c5c6010c-ef4c-4885-adef-cf9bd37f1b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c', 'volume_size': 1}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:52 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873 1G" returned: 0 in 1.150s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:52 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.831s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:03:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Deleted volume successfully.
Jul 03 13:03:52 devstack sudo[102032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873
Jul 03 13:03:52 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ee6786-518b-462d-bd93-e3ca759cf90a tempest-VolumesGetTest-1222645544 None] Lock "cinder-789fddfc-5f61-4c4d-830b-294b754d8421-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (96a5ebbe-28f7-4b41-a8a7-8da4245bbd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280d0083-6ae9-4aec-932a-3e0371a55e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280d0083-6ae9-4aec-932a-3e0371a55e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1999563232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cf41f8-7e88-4772-8a29-65a4621bb394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:54Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5da3bd-be42-4d7b-aeac-4d1677fbb8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5da3bd-be42-4d7b-aeac-4d1677fbb8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccada3d4-f5e0-41e2-9cc6-267fd80b9840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccada3d4-f5e0-41e2-9cc6-267fd80b9840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8cf41f8-7e88-4772-8a29-65a4621bb394', 'volume_name': 'volume-a8cf41f8-7e88-4772-8a29-65a4621bb394', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a910a4-f8f5-42cd-a0fb-3fac49188596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a910a4-f8f5-42cd-a0fb-3fac49188596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f83d23d-a6b9-494b-8048-353937952ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Volume a8cf41f8-7e88-4772-8a29-65a4621bb394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8cf41f8-7e88-4772-8a29-65a4621bb394', 'volume_size': 1}
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:53 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873" returned: 0 in 0.899s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:53 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873 is being set with open permissions: ugo+rw
Jul 03 13:03:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:53 devstack sudo[102037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873
Jul 03 13:03:53 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:54 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873" returned: 0 in 0.816s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.994s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.468s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] Creating offline snapshot 7c0b38f7-3af2-4718-8b83-d03089d79a72 of volume 4cc19fc2-9c84-442b-9331-cf72d0f82939 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:03:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-52a1541a-bbc6-4819-830c-729af5a4773e tempest-VolumesDeleteCascade-600258318 None] Create snapshot completed successfully
Jul 03 13:03:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[28df9e31-599f-4dff-a459-ac134ccb8c96]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:54 devstack sudo[102040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939
Jul 03 13:03:54 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-d84a89ea-ab42-46be-b42c-bb2346cecfa7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-d84a89ea-ab42-46be-b42c-bb2346cecfa7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Performing cascade delete. {{(pid=86763) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-1bddae8f-f772-4e40-9fdd-930b19178873-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-1bddae8f-f772-4e40-9fdd-930b19178873-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-quobyte-d84a89ea-ab42-46be-b42c-bb2346cecfa7" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-d84a89ea-ab42-46be-b42c-bb2346cecfa7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-quobyte-1bddae8f-f772-4e40-9fdd-930b19178873" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-1bddae8f-f772-4e40-9fdd-930b19178873" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Deleting offline snapshot 1bddae8f-f772-4e40-9fdd-930b19178873 of volume d84a89ea-ab42-46be-b42c-bb2346cecfa7 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] snapshot_file for this snap is: volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd69ffb-7004-47ee-af84-3f7f0a036737]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:55 devstack sudo[102042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873
Jul 03 13:03:55 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:55 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939" returned: 0 in 1.028s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:55 devstack sudo[102047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72 1G
Jul 03 13:03:55 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:56 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873" returned: 0 in 0.991s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:03:56 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f43dcd-e91c-4ce5-964d-00333d804fbb]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:56 devstack sudo[102053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c
Jul 03 13:03:56 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:56 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72 1G" returned: 0 in 1.020s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:56 devstack sudo[102058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72
Jul 03 13:03:56 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:57 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c" returned: 0 in 0.955s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:03:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:57 devstack sudo[102063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873
Jul 03 13:03:57 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:57 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72" returned: 0 in 0.855s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:57 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72 is being set with open permissions: ugo+rw
Jul 03 13:03:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:57 devstack sudo[102103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72
Jul 03 13:03:57 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:58 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873" returned: 0 in 0.982s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:58 devstack sudo[102111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873
Jul 03 13:03:58 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:58 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72" returned: 0 in 0.775s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:58 devstack sudo[102113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.info
Jul 03 13:03:58 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:59 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.1bddae8f-f772-4e40-9fdd-930b19178873" returned: 0 in 0.793s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-1bddae8f-f772-4e40-9fdd-930b19178873" released by "_delete_snapshot" :: held 3.850s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-d84a89ea-ab42-46be-b42c-bb2346cecfa7" released by "delete_snapshot" :: held 3.881s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Created reservations ['c8a2037a-388c-4efd-8630-b95619834667', '8138ae51-72da-4bac-b719-d0684f96e8e6', '69e7d5cf-d7d3-4b96-b0aa-81eddaf0ed88', 'ae1ce5a3-a36c-4ac9-8a07-688a2c23a33b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:59 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.info" returned: 0 in 0.816s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:59 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.info is being set with open permissions: ugo+rw
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:59 devstack sudo[102118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.info
Jul 03 13:03:59 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Delete snapshot completed successfully.
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-1bddae8f-f772-4e40-9fdd-930b19178873-delete_snapshot" released by "delete_snapshot" :: held 4.093s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-359597cc-6298-48e6-9b32-966233997f0c-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-359597cc-6298-48e6-9b32-966233997f0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-quobyte-d84a89ea-ab42-46be-b42c-bb2346cecfa7" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-d84a89ea-ab42-46be-b42c-bb2346cecfa7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-quobyte-359597cc-6298-48e6-9b32-966233997f0c" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-359597cc-6298-48e6-9b32-966233997f0c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Deleting offline snapshot 359597cc-6298-48e6-9b32-966233997f0c of volume d84a89ea-ab42-46be-b42c-bb2346cecfa7 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] snapshot_file for this snap is: volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1e9ce2-eb1b-470d-bc08-e417c9b17743]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:59 devstack sudo[102120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c
Jul 03 13:03:59 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:59 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.info" returned: 0 in 0.777s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.414s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.544s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-55484739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c6010c-ef4c-4885-adef-cf9bd37f1b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d3318bdd34e958672d07849004dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:52Z,use_quota=True,user_id='60de11af8b1e48aab3f514ca7dee655d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Creating volume c5c6010c-ef4c-4885-adef-cf9bd37f1b8c {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:00 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:00 devstack sudo[102123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c 1073741824
Jul 03 13:04:00 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bc6ac1c3-5080-4223-9fbe-1dcb91f550f6 tempest-CreateVolumesFromSnapshotTest-899081313 None] Create snapshot completed successfully
Jul 03 13:04:00 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c" returned: 0 in 0.951s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f692dea-cf51-49f8-bba8-d0f6b084e183]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:00 devstack sudo[102129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7
Jul 03 13:04:00 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:01 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c 1073741824" returned: 0 in 1.002s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:01 devstack sudo[102134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c
Jul 03 13:04:01 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (a5a97660-88e7-4527-bc11-605344b8368c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:01 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eebb3d6-8c63-4b9c-a667-8e6c16da2d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7" returned: 0 in 1.028s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eebb3d6-8c63-4b9c-a667-8e6c16da2d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1693899013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a419830-f40f-4e16-be02-f8c382acd2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:01Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:01 devstack sudo[102142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c
Jul 03 13:04:01 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7cbcce-f7b6-40f7-a91c-86db2982bcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7cbcce-f7b6-40f7-a91c-86db2982bcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac0f121-f1cd-4814-9de9-ccf3062eafa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac0f121-f1cd-4814-9de9-ccf3062eafa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a419830-f40f-4e16-be02-f8c382acd2ad', 'volume_name': 'volume-9a419830-f40f-4e16-be02-f8c382acd2ad', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc004731-e660-484e-afff-045c784bbc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc004731-e660-484e-afff-045c784bbc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65efd9d9-c1ed-4b48-b501-0b436f04cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume 9a419830-f40f-4e16-be02-f8c382acd2ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a419830-f40f-4e16-be02-f8c382acd2ad', 'volume_size': 1}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (f583ad49-07df-4041-bff2-127ec732d177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c144be-47f3-486d-ae40-a42d3d4d1c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c144be-47f3-486d-ae40-a42d3d4d1c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-650610250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7a99d1-e82c-4678-9c83-eefcad763662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:02Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2966ddd9-0d7f-4955-9f1e-47edfc81bf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2966ddd9-0d7f-4955-9f1e-47edfc81bf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:01 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8bd6c8-51c8-40df-9a67-32f461ef54fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8bd6c8-51c8-40df-9a67-32f461ef54fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7a99d1-e82c-4678-9c83-eefcad763662', 'volume_name': 'volume-7f7a99d1-e82c-4678-9c83-eefcad763662', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc98675-6df2-492c-aa1e-a3ada333ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc98675-6df2-492c-aa1e-a3ada333ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb11aa5e-343b-4289-b450-f11ff35c9bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume 7f7a99d1-e82c-4678-9c83-eefcad763662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7a99d1-e82c-4678-9c83-eefcad763662', 'volume_size': 1}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c" returned: 0 in 0.951s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.358s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1999563232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cf41f8-7e88-4772-8a29-65a4621bb394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:54Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Creating volume a8cf41f8-7e88-4772-8a29-65a4621bb394 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:02 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac13a0e-b18d-47ef-86ab-0db45f0c20cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc606ef-21e4-4246-9c59-4d8c3745b1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:02 devstack sudo[102145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 1073741824
Jul 03 13:04:02 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Volume volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c (c5c6010c-ef4c-4885-adef-cf9bd37f1b8c): created successfully
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc606ef-21e4-4246-9c59-4d8c3745b1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Flow 'volume_create_manager' (4055b4e1-52b0-4d0a-9c38-ac7d369163fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f3b4c7c4-8bb0-45e8-9fd5-1bcb7c955246 tempest-CinderUnicodeTest-216483861 None] Created volume successfully.
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (d88ddfb7-ad62-4fed-8fc5-4b8951dd94cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c2d78e-8fbc-4f04-9e9e-e38d5de7aef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:02 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c" returned: 0 in 1.149s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c2d78e-8fbc-4f04-9e9e-e38d5de7aef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1241214608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb349e09-9807-45f0-8b6e-21c9cc52aa70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:02Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f3eca8-763a-4668-a1fd-312a0454bdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f3eca8-763a-4668-a1fd-312a0454bdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:02 devstack sudo[102150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c
Jul 03 13:04:02 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d557096f-76fe-4f59-a8e8-3c6e1d7e983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d557096f-76fe-4f59-a8e8-3c6e1d7e983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb349e09-9807-45f0-8b6e-21c9cc52aa70', 'volume_name': 'volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f25f94-ff97-4288-9248-a1d032f19ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f25f94-ff97-4288-9248-a1d032f19ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9397cb-c591-4b13-ac70-84be4df2602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume cb349e09-9807-45f0-8b6e-21c9cc52aa70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70', 'volume_size': 1}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (0e399a86-0488-4ba8-b2d9-3f711ff0d61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559a10a3-e72d-4657-822f-9566f2962fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559a10a3-e72d-4657-822f-9566f2962fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200907513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95ec50f-8c61-4b96-a802-b3665e762426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:03Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609f6aea-62b5-4110-926f-a4df955a886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609f6aea-62b5-4110-926f-a4df955a886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94f019e-4d56-48bf-8512-c58fa34872c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94f019e-4d56-48bf-8512-c58fa34872c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a95ec50f-8c61-4b96-a802-b3665e762426', 'volume_name': 'volume-a95ec50f-8c61-4b96-a802-b3665e762426', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17504069-18ae-4558-ae2f-ad0b91bf1c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17504069-18ae-4558-ae2f-ad0b91bf1c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e94aac-b7d4-4de9-8bdf-c0f7194f49cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume a95ec50f-8c61-4b96-a802-b3665e762426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a95ec50f-8c61-4b96-a802-b3665e762426', 'volume_size': 1}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:03 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 1073741824" returned: 0 in 1.470s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:03 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (c0170388-0a99-4730-867f-358a8a8ba647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4316ec0-2595-4788-ad58-59e7c791aa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7.359597cc-6298-48e6-9b32-966233997f0c" returned: 0 in 1.113s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4316ec0-2595-4788-ad58-59e7c791aa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-789905485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af30ceed-3a17-470e-addd-c21f4198fafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:03Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c575ba9-231e-4378-af97-345c009ebaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c575ba9-231e-4378-af97-345c009ebaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0831bb7-aa3c-4fe4-a5dc-2bf684469739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0831bb7-aa3c-4fe4-a5dc-2bf684469739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af30ceed-3a17-470e-addd-c21f4198fafd', 'volume_name': 'volume-af30ceed-3a17-470e-addd-c21f4198fafd', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6cce49-f678-4afd-b93a-c86864f3600a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6cce49-f678-4afd-b93a-c86864f3600a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189d551b-750f-4d12-869a-09dc8ce4132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume af30ceed-3a17-470e-addd-c21f4198fafd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af30ceed-3a17-470e-addd-c21f4198fafd', 'volume_size': 1}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-359597cc-6298-48e6-9b32-966233997f0c" released by "_delete_snapshot" :: held 4.446s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-d84a89ea-ab42-46be-b42c-bb2346cecfa7" released by "delete_snapshot" :: held 4.483s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:03 devstack sudo[102157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394
Jul 03 13:04:03 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Created reservations ['eb975ac7-f083-4c5b-9b35-e43b7d005fa9', 'c0b1fc52-b32e-41a9-a5ca-41a7004b8598', '8053123f-f96a-4e98-a1fc-94be21c4d158', '6e92a994-5901-4860-98f0-a973f366e9c6'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Delete snapshot completed successfully.
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-359597cc-6298-48e6-9b32-966233997f0c-delete_snapshot" released by "delete_snapshot" :: held 4.677s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Snapshots deleted, issuing volume delete {{(pid=86763) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 03 13:04:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-quobyte-d84a89ea-ab42-46be-b42c-bb2346cecfa7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-d84a89ea-ab42-46be-b42c-bb2346cecfa7" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[382d77b9-94b1-4df7-93c9-8e5ff5f880e8]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:04 devstack sudo[102159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7
Jul 03 13:04:04 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:04 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394" returned: 0 in 0.845s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] <== create_volume: return (2609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.615s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.151s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1693899013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a419830-f40f-4e16-be02-f8c382acd2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:01Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Creating volume 9a419830-f40f-4e16-be02-f8c382acd2ad {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:04 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f83d23d-a6b9-494b-8048-353937952ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8cf41f8-7e88-4772-8a29-65a4621bb394', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ba9f01-2ad6-4f0b-9dd0-fac70ed174f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:04 devstack sudo[102168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad 1073741824
Jul 03 13:04:04 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Volume volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 (a8cf41f8-7e88-4772-8a29-65a4621bb394): created successfully
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ba9f01-2ad6-4f0b-9dd0-fac70ed174f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (96a5ebbe-28f7-4b41-a8a7-8da4245bbd61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-09f6a154-2cc3-491e-a049-7d5ae0e5d415 tempest-VolumesGetTest-1222645544 None] Created volume successfully.
Jul 03 13:04:04 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7" returned: 0 in 0.933s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:05 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7
Jul 03 13:04:05 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:05 devstack sudo[102175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:05 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:05 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d84a89ea-ab42-46be-b42c-bb2346cecfa7" returned: 0 in 0.760s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:05 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad 1073741824" returned: 0 in 1.104s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-d84a89ea-ab42-46be-b42c-bb2346cecfa7" released by "delete_volume" :: held 1.777s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:05 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad
Jul 03 13:04:05 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Created reservations ['bcfa6f82-0222-432e-9d6f-e36517094052', 'f76db7a3-dcc1-4d59-9f31-698108a82f8c', '3190dc36-c898-4c19-99c7-f6612edf9f9c', '2ead6800-47c3-4fdd-a0b1-a9d83ca6bbfa'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:05 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.894s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:06 devstack sudo[102184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:06 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (814fa9e6-6f45-4f57-8e2e-8af2f24ff4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09c3ffb-8de4-473d-8ae0-f56135f6b41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09c3ffb-8de4-473d-8ae0-f56135f6b41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-222011780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249f047d-68ce-4936-9ddf-31ee1bcffade,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=a8cf41f8-7e88-4772-8a29-65a4621bb394,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:06Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d64642-5685-4438-8260-70978afc832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d64642-5685-4438-8260-70978afc832b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedfeca8-18f5-4de6-b6bc-e0c307fa7196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedfeca8-18f5-4de6-b6bc-e0c307fa7196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '249f047d-68ce-4936-9ddf-31ee1bcffade', 'volume_name': 'volume-249f047d-68ce-4936-9ddf-31ee1bcffade', 'volume_size': 1, 'source_volid': 'a8cf41f8-7e88-4772-8a29-65a4621bb394', 'source_volstatus': 'available'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6e7f02-a6b6-4bee-b0e2-5a1a5949a1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6e7f02-a6b6-4bee-b0e2-5a1a5949a1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c43e113-9078-48b1-876c-8f7280b37b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:06 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Volume 249f047d-68ce-4936-9ddf-31ee1bcffade: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-249f047d-68ce-4936-9ddf-31ee1bcffade', 'volume_size': 1, 'source_volid': 'a8cf41f8-7e88-4772-8a29-65a4621bb394', 'source_volstatus': 'available'}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:06 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad" returned: 0 in 0.991s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.811s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-650610250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7a99d1-e82c-4678-9c83-eefcad763662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:02Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Creating volume 7f7a99d1-e82c-4678-9c83-eefcad763662 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:06 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:06 devstack sudo[102188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662 1073741824
Jul 03 13:04:06 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65efd9d9-c1ed-4b48-b501-0b436f04cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a419830-f40f-4e16-be02-f8c382acd2ad', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ef8631-5ac9-4db1-ae48-cc184599c3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:06 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume volume-9a419830-f40f-4e16-be02-f8c382acd2ad (9a419830-f40f-4e16-be02-f8c382acd2ad): created successfully
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ef8631-5ac9-4db1-ae48-cc184599c3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (a5a97660-88e7-4527-bc11-605344b8368c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Flow 'volume_create_manager' (79d25519-f902-4a8c-9551-3ccb73dcd731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5400e82a-9534-45e7-89c2-8a994f30686d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:06 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-45d5752b-2225-4e47-b54f-0af905c0c16d tempest-CreateVolumesFromSnapshotTest-899081313 None] Created volume successfully.
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.938s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5400e82a-9534-45e7-89c2-8a994f30686d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2014498617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef46cc1-fc65-4cf1-ab23-9046a10c3c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9153792b0b45d58245258f2ed18f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:07Z,use_quota=True,user_id='e07dd503fd3d4ac0948b107a87ab76ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a96013-6dc0-4c51-b254-118285542a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a96013-6dc0-4c51-b254-118285542a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b88dae1-09f2-4a11-aff9-fddb97f10a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b88dae1-09f2-4a11-aff9-fddb97f10a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef46cc1-fc65-4cf1-ab23-9046a10c3c26', 'volume_name': 'volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0960b143-87e8-43c8-9f5d-6d3743466836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0960b143-87e8-43c8-9f5d-6d3743466836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444cf5bf-9017-447a-b714-cbb8d932e13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Volume 0ef46cc1-fc65-4cf1-ab23-9046a10c3c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26', 'volume_size': 1}
Jul 03 13:04:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:07 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Deleted volume successfully.
Jul 03 13:04:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e4d3846-3aff-4ac7-8f97-e4d788e099b9 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-d84a89ea-ab42-46be-b42c-bb2346cecfa7-delete_volume" released by "delete_volume" :: held 11.981s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:07 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662 1073741824" returned: 0 in 0.951s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:07 devstack sudo[102194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662
Jul 03 13:04:07 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:08 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662" returned: 0 in 0.762s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.945s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1241214608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb349e09-9807-45f0-8b6e-21c9cc52aa70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:02Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Creating volume cb349e09-9807-45f0-8b6e-21c9cc52aa70 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:08 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb11aa5e-343b-4289-b450-f11ff35c9bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7a99d1-e82c-4678-9c83-eefcad763662', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:08 devstack sudo[102197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70 1073741824
Jul 03 13:04:08 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc83c35-1abf-4034-ad36-69e8ae8e9df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:08 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume volume-7f7a99d1-e82c-4678-9c83-eefcad763662 (7f7a99d1-e82c-4678-9c83-eefcad763662): created successfully
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc83c35-1abf-4034-ad36-69e8ae8e9df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (f583ad49-07df-4041-bff2-127ec732d177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-42961629-e01d-4d98-a0ff-d4f00848444f tempest-CreateVolumesFromSnapshotTest-899081313 None] Created volume successfully.
Jul 03 13:04:09 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70 1073741824" returned: 0 in 0.973s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:09 devstack sudo[102202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70
Jul 03 13:04:09 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:10 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70" returned: 0 in 0.783s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.392s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200907513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95ec50f-8c61-4b96-a802-b3665e762426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:03Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Creating volume a95ec50f-8c61-4b96-a802-b3665e762426 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:10 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9397cb-c591-4b13-ac70-84be4df2602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:10 devstack sudo[102206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426 1073741824
Jul 03 13:04:10 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f97fc1c-065c-4fe5-8ace-be9650f8ec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70 (cb349e09-9807-45f0-8b6e-21c9cc52aa70): created successfully
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f97fc1c-065c-4fe5-8ace-be9650f8ec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (d88ddfb7-ad62-4fed-8fc5-4b8951dd94cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7bf44796-2fbd-4b1d-9d89-3ef00bba537f tempest-CreateVolumesFromSnapshotTest-899081313 None] Created volume successfully.
Jul 03 13:04:11 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426 1073741824" returned: 0 in 1.027s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:11 devstack sudo[102212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426
Jul 03 13:04:11 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:12 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426" returned: 0 in 0.756s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.481s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-789905485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af30ceed-3a17-470e-addd-c21f4198fafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b8cff1db9d4a7c870a30af119b0be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:03Z,use_quota=True,user_id='01ebdb8ac1a44318b41c8d4cd62c9caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Creating volume af30ceed-3a17-470e-addd-c21f4198fafd {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:12 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:12 devstack sudo[102215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd 1073741824
Jul 03 13:04:12 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e94aac-b7d4-4de9-8bdf-c0f7194f49cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95ec50f-8c61-4b96-a802-b3665e762426', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3884666-87ba-4354-b824-fa6b2bf73762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:12 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume volume-a95ec50f-8c61-4b96-a802-b3665e762426 (a95ec50f-8c61-4b96-a802-b3665e762426): created successfully
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3884666-87ba-4354-b824-fa6b2bf73762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (0e399a86-0488-4ba8-b2d9-3f711ff0d61d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1ac5639a-0fd7-49e9-99c9-b3c3ece705c9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Created volume successfully.
Jul 03 13:04:13 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd 1073741824" returned: 0 in 0.998s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:13 devstack sudo[102221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd
Jul 03 13:04:13 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:14 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd" returned: 0 in 0.686s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.170s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189d551b-750f-4d12-869a-09dc8ce4132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af30ceed-3a17-470e-addd-c21f4198fafd', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1893ef77-a7c3-4df5-8075-b81850d51cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] Creating offline snapshot d84ea522-9ea4-41bc-bd4f-723121022620 of volume c5c6010c-ef4c-4885-adef-cf9bd37f1b8c {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:04:14 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Volume volume-af30ceed-3a17-470e-addd-c21f4198fafd (af30ceed-3a17-470e-addd-c21f4198fafd): created successfully
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1893ef77-a7c3-4df5-8075-b81850d51cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Flow 'volume_create_manager' (c0170388-0a99-4730-867f-358a8a8ba647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bf4a9f-c5f3-4e4a-9d0d-1011ec13acac]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4fb5648e-ee8e-49ca-9893-12ce35a6511c tempest-CreateVolumesFromSnapshotTest-899081313 None] Created volume successfully.
Jul 03 13:04:14 devstack sudo[102224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c
Jul 03 13:04:14 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-af30ceed-3a17-470e-addd-c21f4198fafd-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-af30ceed-3a17-470e-addd-c21f4198fafd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-quobyte-af30ceed-3a17-470e-addd-c21f4198fafd" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-af30ceed-3a17-470e-addd-c21f4198fafd" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca64790-0e82-4f6a-bf49-2068e2954dea]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:14 devstack sudo[102226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd
Jul 03 13:04:14 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:14 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c" returned: 0 in 0.827s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:14 devstack sudo[102231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620 1G
Jul 03 13:04:14 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:15 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd" returned: 0 in 0.812s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:15 devstack sudo[102236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd
Jul 03 13:04:15 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:15 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620 1G" returned: 0 in 0.921s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:15 devstack sudo[102241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620
Jul 03 13:04:15 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:16 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-af30ceed-3a17-470e-addd-c21f4198fafd" returned: 0 in 0.784s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-af30ceed-3a17-470e-addd-c21f4198fafd" released by "delete_volume" :: held 1.661s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Created reservations ['3108a046-6f66-4217-8904-4356a3c65117', 'e40b145a-a541-4bea-8519-4477a1125769', '5f54cfaf-8c34-4b49-86e7-aab439b24792', 'b5eb6789-5e11-4b1d-9868-317b09d790a4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:16 devstack sudo[102244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:16 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:16 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620" returned: 0 in 0.783s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:16 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620 is being set with open permissions: ugo+rw
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:16 devstack sudo[102249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620
Jul 03 13:04:16 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-a95ec50f-8c61-4b96-a802-b3665e762426-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-a95ec50f-8c61-4b96-a802-b3665e762426-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-quobyte-a95ec50f-8c61-4b96-a802-b3665e762426" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-a95ec50f-8c61-4b96-a802-b3665e762426" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[751bf5b1-cc50-488b-9a1f-a7677d524034]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:17 devstack sudo[102251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426
Jul 03 13:04:17 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:17 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.831s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:17 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Deleted volume successfully.
Jul 03 13:04:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-62cf9250-cfcc-4825-b043-44a65356bf14 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-af30ceed-3a17-470e-addd-c21f4198fafd-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:17 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620" returned: 0 in 0.807s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:17 devstack sudo[102255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.info
Jul 03 13:04:17 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:17 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426" returned: 0 in 0.886s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:17 devstack sudo[102260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426
Jul 03 13:04:17 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:18 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.info" returned: 0 in 0.790s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:18 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.info is being set with open permissions: ugo+rw
Jul 03 13:04:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:18 devstack sudo[102263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.info
Jul 03 13:04:18 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:18 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a95ec50f-8c61-4b96-a802-b3665e762426" returned: 0 in 0.733s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-a95ec50f-8c61-4b96-a802-b3665e762426" released by "delete_volume" :: held 1.671s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Created reservations ['d141c866-f71d-4c29-a869-5eacc7de6d57', 'bd910a08-7627-4b8a-9696-5519401d982e', '5baf6a42-f2c4-4df4-818a-d653555d638a', 'f06ebc48-43cd-4e86-a107-a5c576132aaf'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:18 devstack sudo[102266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:18 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:19 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.info" returned: 0 in 0.758s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.026s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 12.712s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:19 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Cloning volume a8cf41f8-7e88-4772-8a29-65a4621bb394 to volume 249f047d-68ce-4936-9ddf-31ee1bcffade
Jul 03 13:04:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-94d272b2-e806-4651-9d2a-18e5c0959123 tempest-CinderUnicodeTest-216483861 None] Create snapshot completed successfully
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-cb349e09-9807-45f0-8b6e-21c9cc52aa70-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Creating offline snapshot aaec3b46-cedb-42d1-896a-b5218309c2ec of volume a8cf41f8-7e88-4772-8a29-65a4621bb394 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-cb349e09-9807-45f0-8b6e-21c9cc52aa70-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0e80bf-68e2-454c-b9b3-f20e5db5170c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-quobyte-cb349e09-9807-45f0-8b6e-21c9cc52aa70" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-cb349e09-9807-45f0-8b6e-21c9cc52aa70" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac179ba-7bf2-4abb-977c-2207842d2d7f]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:19 devstack sudo[102269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394
Jul 03 13:04:19 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:19 devstack sudo[102270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70
Jul 03 13:04:19 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Acquiring lock "cinder-d84ea522-9ea4-41bc-bd4f-723121022620-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:19 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.834s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Lock "cinder-d84ea522-9ea4-41bc-bd4f-723121022620-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Acquiring lock "cinder-quobyte-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Deleted volume successfully.
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Lock "cinder-quobyte-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Acquiring lock "cinder-quobyte-d84ea522-9ea4-41bc-bd4f-723121022620" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cb27ae77-a217-4e72-bf24-210cff73b274 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-a95ec50f-8c61-4b96-a802-b3665e762426-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Lock "cinder-quobyte-d84ea522-9ea4-41bc-bd4f-723121022620" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Deleting offline snapshot d84ea522-9ea4-41bc-bd4f-723121022620 of volume c5c6010c-ef4c-4885-adef-cf9bd37f1b8c {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] snapshot_file for this snap is: volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[114fe49b-7c3a-4744-9924-43fc647c583b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:19 devstack sudo[102274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620
Jul 03 13:04:19 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:20 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394" returned: 0 in 1.107s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:20 devstack sudo[102283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec 1G
Jul 03 13:04:20 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:20 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70" returned: 0 in 1.121s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:20 devstack sudo[102286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70
Jul 03 13:04:20 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:20 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620" returned: 0 in 0.958s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:04:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[03808840-8ab6-4724-bba5-d0112874adb6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:20 devstack sudo[102291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c
Jul 03 13:04:20 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:21 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb349e09-9807-45f0-8b6e-21c9cc52aa70" returned: 0 in 0.885s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-cb349e09-9807-45f0-8b6e-21c9cc52aa70" released by "delete_volume" :: held 2.063s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:21 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec 1G" returned: 0 in 1.042s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:21 devstack sudo[102297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec
Jul 03 13:04:21 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Created reservations ['30c523c3-1fd8-4125-b305-be798c2baab8', 'f2eed066-c45e-4b32-aa91-c41eee667bde', '433d4709-b466-4ce2-911d-4decf0286f58', 'dc20be7b-d236-42d8-a640-1e45a9f7e1c4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:21 devstack sudo[102299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:21 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:21 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c" returned: 0 in 1.001s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:21 devstack sudo[102304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620
Jul 03 13:04:21 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:22 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:22 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec" returned: 0 in 0.960s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.791s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:22 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec is being set with open permissions: ugo+rw
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Deleted volume successfully.
Jul 03 13:04:22 devstack sudo[102310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec
Jul 03 13:04:22 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2e51d052-cff6-449c-8d35-02516b3fea99 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-cb349e09-9807-45f0-8b6e-21c9cc52aa70-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-7f7a99d1-e82c-4678-9c83-eefcad763662-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-7f7a99d1-e82c-4678-9c83-eefcad763662-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-quobyte-7f7a99d1-e82c-4678-9c83-eefcad763662" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-7f7a99d1-e82c-4678-9c83-eefcad763662" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:22 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620" returned: 0 in 0.936s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[67392314-e5a9-4330-9ca9-44a0b1f020ea]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:22 devstack sudo[102315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620
Jul 03 13:04:22 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:22 devstack sudo[102316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662
Jul 03 13:04:22 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:23 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec" returned: 0 in 0.981s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:23 devstack sudo[102320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.info
Jul 03 13:04:23 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:23 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c.d84ea522-9ea4-41bc-bd4f-723121022620" returned: 0 in 0.894s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Lock "cinder-quobyte-d84ea522-9ea4-41bc-bd4f-723121022620" released by "_delete_snapshot" :: held 3.944s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Lock "cinder-quobyte-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c" released by "delete_snapshot" :: held 3.990s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:23 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662" returned: 0 in 1.016s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:23 devstack sudo[102326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662
Jul 03 13:04:23 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:23 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Created reservations ['6275bd61-e3b6-4583-8523-0ffcf1b830d8', '998c8c1b-ce20-468e-b9aa-1657350dc40d', '66470d29-5201-4ded-9fb9-706f182e1854', 'c84ec99e-9afd-49f2-b776-2130bda1e142'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Delete snapshot completed successfully.
Jul 03 13:04:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d4c9cc2-3e1e-4509-9d6f-dd56fca97d6c tempest-CinderUnicodeTest-216483861 None] Lock "cinder-d84ea522-9ea4-41bc-bd4f-723121022620-delete_snapshot" released by "delete_snapshot" :: held 4.232s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:24 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.info" returned: 0 in 0.802s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:24 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.info is being set with open permissions: ugo+rw
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:24 devstack sudo[102329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.info
Jul 03 13:04:24 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:24 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7f7a99d1-e82c-4678-9c83-eefcad763662" returned: 0 in 0.851s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-7f7a99d1-e82c-4678-9c83-eefcad763662" released by "delete_volume" :: held 1.921s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Created reservations ['a6c15686-4b4d-47a9-991a-7fba164e7c69', '2dee6b61-14db-4e3d-b0ad-a6de177ed6cf', '9f1f3dd8-9dca-4dc4-b900-ad9c882b2a80', 'f205f723-f8b7-418d-bffe-bc8fe95583fd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:24 devstack sudo[102333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:24 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-9a419830-f40f-4e16-be02-f8c382acd2ad-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-9a419830-f40f-4e16-be02-f8c382acd2ad-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:24 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.info" returned: 0 in 0.796s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-quobyte-249f047d-68ce-4936-9ddf-31ee1bcffade" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Acquiring lock "cinder-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-quobyte-9a419830-f40f-4e16-be02-f8c382acd2ad" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-249f047d-68ce-4936-9ddf-31ee1bcffade" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] snapshot: aaec3b46-cedb-42d1-896a-b5218309c2ec, volume: 249f047d-68ce-4936-9ddf-31ee1bcffade,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-9a419830-f40f-4e16-be02-f8c382acd2ad" acquired by "delete_volume" :: waited 0.071s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Lock "cinder-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8ed9ce-e77d-48c9-a991-659cade1ecc0]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c0e92b-c879-4fa3-950a-03c15009bfd7]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Acquiring lock "cinder-quobyte-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Lock "cinder-quobyte-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:25 devstack sudo[102336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec
Jul 03 13:04:25 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:25 devstack sudo[102337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad
Jul 03 13:04:25 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17e1113-82a8-451d-a5f5-274a115ec6ae]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:25 devstack sudo[102340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c
Jul 03 13:04:25 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:25 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.830s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Deleted volume successfully.
Jul 03 13:04:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f2c9a512-ecea-44fe-8f97-94b0df2a70d9 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-7f7a99d1-e82c-4678-9c83-eefcad763662-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:25 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec" returned: 0 in 0.963s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8cf41f8-7e88-4772-8a29-65a4621bb394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:04:26 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad" returned: 0 in 0.958s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cabcb73-9035-4f50-90d9-d3dea746edec]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:26 devstack sudo[102349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad
Jul 03 13:04:26 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:26 devstack sudo[102350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394
Jul 03 13:04:26 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:26 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c" returned: 0 in 1.061s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:26 devstack sudo[102356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c
Jul 03 13:04:26 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:26 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9a419830-f40f-4e16-be02-f8c382acd2ad" returned: 0 in 0.803s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-9a419830-f40f-4e16-be02-f8c382acd2ad" released by "delete_volume" :: held 1.815s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Created reservations ['4d5d50e1-64e5-4cf8-a913-743a95fa447f', 'cf20c069-a96a-4fe9-9d48-64ac9a1203d8', '4d9fee40-47f7-4005-82a1-fa61806171a3', '1643a813-cbaf-4691-b2dd-23f7a4174e78'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:26 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394" returned: 0 in 0.914s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 13:04:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:26 devstack sudo[102363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade
Jul 03 13:04:26 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:27 devstack sudo[102365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:27 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:27 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c" returned: 0 in 0.777s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Lock "cinder-quobyte-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c" released by "delete_volume" :: held 1.922s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-7c0b38f7-3af2-4718-8b83-d03089d79a72-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Created reservations ['31c8aafc-1fc7-4d3f-a687-c8fcc3eb3d65', '65d637f7-7a31-41be-9e37-a3ef4aefde2d', 'ee53905a-b1f2-4d5c-b63f-a7d8bb0ea458', 'b3d0a834-a957-42bc-9cc5-eb3fb23bc8a3'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-7c0b38f7-3af2-4718-8b83-d03089d79a72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-quobyte-4cc19fc2-9c84-442b-9331-cf72d0f82939" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-4cc19fc2-9c84-442b-9331-cf72d0f82939" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-quobyte-7c0b38f7-3af2-4718-8b83-d03089d79a72" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-7c0b38f7-3af2-4718-8b83-d03089d79a72" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Deleting offline snapshot 7c0b38f7-3af2-4718-8b83-d03089d79a72 of volume 4cc19fc2-9c84-442b-9331-cf72d0f82939 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] snapshot_file for this snap is: volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dbf5fe-2242-4b63-a704-9bd3984efae6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:27 devstack sudo[102368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:27 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:27 devstack sudo[102367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72
Jul 03 13:04:27 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:27 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.830s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Deleted volume successfully.
Jul 03 13:04:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-28001b90-31bc-4869-9248-1ff91c52fb1b tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-9a419830-f40f-4e16-be02-f8c382acd2ad-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:28 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.036s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Deleted volume successfully.
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3ec74a0f-807f-4e6e-940d-ff2d913354ce tempest-CinderUnicodeTest-216483861 None] Lock "cinder-c5c6010c-ef4c-4885-adef-cf9bd37f1b8c-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Acquiring lock "cinder-495190ef-b41d-46fd-a7a6-234b60554b93-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Lock "cinder-495190ef-b41d-46fd-a7a6-234b60554b93-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:28 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72" returned: 0 in 1.347s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc19fc2-9c84-442b-9331-cf72d0f82939(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d457a284-2e9d-43f2-b4b0-1950c1ea7e33]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Acquiring lock "cinder-quobyte-495190ef-b41d-46fd-a7a6-234b60554b93" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Lock "cinder-quobyte-495190ef-b41d-46fd-a7a6-234b60554b93" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fab3db1-2c38-4b3f-8c42-8eeacdbbec29]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:29 devstack sudo[102388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939
Jul 03 13:04:29 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:29 devstack sudo[102389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93
Jul 03 13:04:29 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:30 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93" returned: 0 in 1.667s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:30 devstack sudo[102400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93
Jul 03 13:04:30 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:30 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939" returned: 0 in 1.953s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:30 devstack sudo[102402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72
Jul 03 13:04:30 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:32 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-495190ef-b41d-46fd-a7a6-234b60554b93" returned: 0 in 1.510s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Lock "cinder-quobyte-495190ef-b41d-46fd-a7a6-234b60554b93" released by "delete_volume" :: held 3.312s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=142,cinder:SELECT=116,cinder:INSERT=36,cinder:DELETE=14 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Created reservations ['01b59159-8a0c-4646-b330-4798a7c7868a', '0635454a-947b-4c7d-be79-4edd19fc4bbd', '6d35ae83-cb0c-4e07-8394-a6969bd4ec0e', '9e977b5a-1e4c-4df2-ac6e-4ab820fa7b1e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:32 devstack sudo[102408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:32 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:32 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72" returned: 0 in 2.225s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:33 devstack sudo[102411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72
Jul 03 13:04:33 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:33 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade" returned: 0 in 6.448s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8751544-b898-42ee-be5b-4a3e0c1b98ac]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:33 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.034s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Deleted volume successfully.
Jul 03 13:04:33 devstack sudo[102414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394
Jul 03 13:04:33 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7d5021e-0186-40ea-9e06-9270a0a8c715 tempest-CinderUnicodeTest-216483861 None] Lock "cinder-495190ef-b41d-46fd-a7a6-234b60554b93-delete_volume" released by "delete_volume" :: held 4.993s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:33 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939.7c0b38f7-3af2-4718-8b83-d03089d79a72" returned: 0 in 0.993s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-7c0b38f7-3af2-4718-8b83-d03089d79a72" released by "_delete_snapshot" :: held 6.715s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-4cc19fc2-9c84-442b-9331-cf72d0f82939" released by "delete_snapshot" :: held 6.750s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:34 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Created reservations ['2596e736-b559-4db1-b4c0-c7fe98c47dc0', 'c850b3f4-a64b-4e1b-8e88-4a9e138285eb', '9425e683-16db-45b3-870b-28a0bea83146', '83121fc1-d62f-48b5-9288-d90c93f91dbc'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Delete snapshot completed successfully.
Jul 03 13:04:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-38402db6-90ca-4089-a276-0b9e43366828 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-7c0b38f7-3af2-4718-8b83-d03089d79a72-delete_snapshot" released by "delete_snapshot" :: held 6.962s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:34 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394" returned: 0 in 1.118s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:34 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:04:34 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Converted 1024.00 MB image at 158.77 MB/s
Jul 03 13:04:34 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade is being set with open permissions: ugo+rw
Jul 03 13:04:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:34 devstack sudo[102420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade
Jul 03 13:04:34 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-4cc19fc2-9c84-442b-9331-cf72d0f82939-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-4cc19fc2-9c84-442b-9331-cf72d0f82939-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "cinder-quobyte-4cc19fc2-9c84-442b-9331-cf72d0f82939" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-4cc19fc2-9c84-442b-9331-cf72d0f82939" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:35 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:INSERT=47,cinder:SELECT=121,cinder:UPDATE=153,cinder:DELETE=13 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:04:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7faa5c9-84a0-4d9f-a60f-3ccdbf7fb26d]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:35 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939
Jul 03 13:04:35 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:35 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade" returned: 0 in 0.889s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-249f047d-68ce-4936-9ddf-31ee1bcffade" released by "_copy_volume_from_snapshot" :: held 10.456s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-quobyte-aaec3b46-cedb-42d1-896a-b5218309c2ec" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-aaec3b46-cedb-42d1-896a-b5218309c2ec" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Deleting offline snapshot aaec3b46-cedb-42d1-896a-b5218309c2ec of volume a8cf41f8-7e88-4772-8a29-65a4621bb394 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:04:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] snapshot_file for this snap is: volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:04:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e174c0-b511-46b7-aec0-950c8f5cd183]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:35 devstack sudo[102426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec
Jul 03 13:04:35 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:36 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939" returned: 0 in 0.962s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:36 devstack sudo[102431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939
Jul 03 13:04:36 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:36 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec" returned: 0 in 0.954s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8cf41f8-7e88-4772-8a29-65a4621bb394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b142d32-d2e7-4424-9e43-7cc9ef024585]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:36 devstack sudo[102436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394
Jul 03 13:04:36 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:36 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4cc19fc2-9c84-442b-9331-cf72d0f82939" returned: 0 in 0.778s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-quobyte-4cc19fc2-9c84-442b-9331-cf72d0f82939" released by "delete_volume" :: held 1.841s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Created reservations ['86d00c6f-d673-4ad7-992f-3044eb1103af', 'c72dc6ad-f339-4c55-bc2f-67ecee2ba06c', '89f1eeb2-d28c-4d00-9326-27f46a31f15e', '8733eef9-3aae-4fd6-a187-305a2e2234e7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:37 devstack sudo[102439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:37 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:37 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394" returned: 0 in 1.049s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:37 devstack sudo[102444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec
Jul 03 13:04:37 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:37 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.921s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Deleted volume successfully.
Jul 03 13:04:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-205c3675-366d-484d-bc27-7d2f64112ee4 tempest-CreateVolumesFromSnapshotTest-899081313 None] Lock "cinder-4cc19fc2-9c84-442b-9331-cf72d0f82939-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:38 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec" returned: 0 in 1.108s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:38 devstack sudo[102453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec
Jul 03 13:04:38 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:39 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394.aaec3b46-cedb-42d1-896a-b5218309c2ec" returned: 0 in 0.831s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-aaec3b46-cedb-42d1-896a-b5218309c2ec" released by "_delete_snapshot" :: held 4.107s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.597s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.604s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2014498617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef46cc1-fc65-4cf1-ab23-9046a10c3c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9153792b0b45d58245258f2ed18f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:07Z,use_quota=True,user_id='e07dd503fd3d4ac0948b107a87ab76ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Creating volume 0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:39 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c43e113-9078-48b1-876c-8f7280b37b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249f047d-68ce-4936-9ddf-31ee1bcffade', 'volume_size': 1, 'source_volid': 'a8cf41f8-7e88-4772-8a29-65a4621bb394', 'source_volstatus': 'available'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:39 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 1073741824
Jul 03 13:04:39 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690ca4c6-bcc0-4c57-87fc-b24d439ed3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:39 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Volume volume-249f047d-68ce-4936-9ddf-31ee1bcffade (249f047d-68ce-4936-9ddf-31ee1bcffade): created successfully
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690ca4c6-bcc0-4c57-87fc-b24d439ed3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (814fa9e6-6f45-4f57-8e2e-8af2f24ff4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-99552a6b-c40d-412c-865a-8d844794cccf tempest-VolumesGetTest-1222645544 None] Created volume successfully.
Jul 03 13:04:40 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 1073741824" returned: 0 in 1.271s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:41 devstack sudo[102463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26
Jul 03 13:04:41 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (3d2e3102-b6d7-4265-a4c0-399a65c49c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171b81d7-2cd2-454a-8e92-979198c13507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171b81d7-2cd2-454a-8e92-979198c13507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-743630911',display_name='tempest-VolumesGetTest-Volume-991599329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7f30c6-9ca3-4ef4-aa49-3976a6e30762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:41Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (257179f7-6d8d-49e4-9bd0-8e2d3b278eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (257179f7-6d8d-49e4-9bd0-8e2d3b278eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5bf219-3574-4063-bf0f-a7b347477b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5bf219-3574-4063-bf0f-a7b347477b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a7f30c6-9ca3-4ef4-aa49-3976a6e30762', 'volume_name': 'volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2cafce-ba23-4ca3-afc9-ebef375e2f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2cafce-ba23-4ca3-afc9-ebef375e2f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b3ed50-d786-40ae-a830-32a0685d95bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:41 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Volume 0a7f30c6-9ca3-4ef4-aa49-3976a6e30762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762', 'volume_size': 1}
Jul 03 13:04:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:42 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" returned: 0 in 1.049s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] <== create_volume: return (2414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.417s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-743630911',display_name='tempest-VolumesGetTest-Volume-991599329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7f30c6-9ca3-4ef4-aa49-3976a6e30762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:41Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Creating volume 0a7f30c6-9ca3-4ef4-aa49-3976a6e30762 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:42 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:42 devstack sudo[102466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762 1073741824
Jul 03 13:04:42 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444cf5bf-9017-447a-b714-cbb8d932e13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0ed8bb-3cd1-42d0-b35f-b536b3296bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:42 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Volume volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 (0ef46cc1-fc65-4cf1-ab23-9046a10c3c26): created successfully
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0ed8bb-3cd1-42d0-b35f-b536b3296bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Flow 'volume_create_manager' (79d25519-f902-4a8c-9551-3ccb73dcd731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7757f131-d47a-44de-badd-07797a0aac85 tempest-VolumesDeleteCascade-600258318 None] Created volume successfully.
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Flow 'volume_create_manager' (b18f11c4-ea80-4f7e-b27f-5b62749dd800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62b40e6-f526-40ce-85ef-2bf38c419df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62b40e6-f526-40ce-85ef-2bf38c419df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671064924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b21c86d-f203-4a25-9edb-8c72794dd878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafc5dc00a984ed5a47f8730af8be9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:43Z,use_quota=True,user_id='4581649a13714520b30b2d8fdcc7e7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca31ef0-51db-48f2-86ce-8ee89aab5729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca31ef0-51db-48f2-86ce-8ee89aab5729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e7e9b9-fa9f-4702-82e8-72e10f317cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e7e9b9-fa9f-4702-82e8-72e10f317cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b21c86d-f203-4a25-9edb-8c72794dd878', 'volume_name': 'volume-2b21c86d-f203-4a25-9edb-8c72794dd878', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887ecd93-98e3-41ae-ae6f-49acd2383a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887ecd93-98e3-41ae-ae6f-49acd2383a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67764394-0608-4d5d-a89f-83b559bc84fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:42 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Volume 2b21c86d-f203-4a25-9edb-8c72794dd878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b21c86d-f203-4a25-9edb-8c72794dd878', 'volume_size': 1}
Jul 03 13:04:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:43 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762 1073741824" returned: 0 in 1.063s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:43 devstack sudo[102471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762
Jul 03 13:04:43 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:44 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762" returned: 0 in 0.838s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671064924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b21c86d-f203-4a25-9edb-8c72794dd878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafc5dc00a984ed5a47f8730af8be9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:43Z,use_quota=True,user_id='4581649a13714520b30b2d8fdcc7e7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Creating volume 2b21c86d-f203-4a25-9edb-8c72794dd878 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:44 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b3ed50-d786-40ae-a830-32a0685d95bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:44 devstack sudo[102474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878 1073741824
Jul 03 13:04:44 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f02b2e-a012-4b81-8950-7d7693a636e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Volume volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762 (0a7f30c6-9ca3-4ef4-aa49-3976a6e30762): created successfully
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f02b2e-a012-4b81-8950-7d7693a636e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (3d2e3102-b6d7-4265-a4c0-399a65c49c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0861b146-110f-4c90-871e-638200cb8872 tempest-VolumesGetTest-1222645544 None] Created volume successfully.
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Lock "cinder-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-quobyte-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2150d5-f221-4201-86a9-9c2e1a58c528]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:45 devstack sudo[102480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762
Jul 03 13:04:45 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:45 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878 1073741824" returned: 0 in 1.127s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:45 devstack sudo[102483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878
Jul 03 13:04:45 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:45 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762" returned: 0 in 0.903s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:45 devstack sudo[102488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762
Jul 03 13:04:45 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:46 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878" returned: 0 in 0.840s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.583s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67764394-0608-4d5d-a89f-83b559bc84fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b21c86d-f203-4a25-9edb-8c72794dd878', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836aa9ef-bfbb-4006-b10c-8f53ad4d6690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] Creating offline snapshot 8fc21094-10d6-4edf-b773-7f03524a00a7 of volume 0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:04:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Volume volume-2b21c86d-f203-4a25-9edb-8c72794dd878 (2b21c86d-f203-4a25-9edb-8c72794dd878): created successfully
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836aa9ef-bfbb-4006-b10c-8f53ad4d6690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Flow 'volume_create_manager' (b18f11c4-ea80-4f7e-b27f-5b62749dd800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da9648-c6bf-49af-9e9e-bdd903c82077]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a006e298-ae94-4ab8-876f-834fa4d9912f tempest-ProjectReaderTests-1761140788 None] Created volume successfully.
Jul 03 13:04:46 devstack sudo[102491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26
Jul 03 13:04:46 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:46 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762" returned: 0 in 0.787s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762" released by "delete_volume" :: held 1.749s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Created reservations ['747ec4dd-0212-4ad4-80d3-3ed635ec66af', '68027581-f6c1-4be2-8a74-27a63959b5e7', '4dd617eb-7b65-4ee2-9063-80ee1f7a3223', '55e542c9-03ff-478c-bd75-4cf7ecaf16c4'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:46 devstack sudo[102494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:46 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-249f047d-68ce-4936-9ddf-31ee1bcffade-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Lock "cinder-249f047d-68ce-4936-9ddf-31ee1bcffade-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-quobyte-249f047d-68ce-4936-9ddf-31ee1bcffade" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-249f047d-68ce-4936-9ddf-31ee1bcffade" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:47 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" returned: 0 in 1.195s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab674185-9d1f-4d82-8347-ac4cfaad4d9e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:47 devstack sudo[102499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7 1G
Jul 03 13:04:47 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:47 devstack sudo[102500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade
Jul 03 13:04:47 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:47 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.945s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Deleted volume successfully.
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0a4c733a-ab45-4467-972e-b5b0d3dfeced tempest-VolumesGetTest-1222645544 None] Lock "cinder-0a7f30c6-9ca3-4ef4-aa49-3976a6e30762-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Acquiring lock "cinder-2b21c86d-f203-4a25-9edb-8c72794dd878-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Lock "cinder-2b21c86d-f203-4a25-9edb-8c72794dd878-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Acquiring lock "cinder-quobyte-2b21c86d-f203-4a25-9edb-8c72794dd878" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Lock "cinder-quobyte-2b21c86d-f203-4a25-9edb-8c72794dd878" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:48 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bce24ab-4d3f-4c49-b768-662f6cd8508f]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:48 devstack sudo[102504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878
Jul 03 13:04:48 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:48 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:48 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade" returned: 0 in 1.311s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7 1G" returned: 0 in 1.366s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:48 devstack sudo[102514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade
Jul 03 13:04:48 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:48 devstack sudo[102515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7
Jul 03 13:04:48 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:49 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878" returned: 0 in 1.133s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:49 devstack sudo[102521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878
Jul 03 13:04:49 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:49 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-249f047d-68ce-4936-9ddf-31ee1bcffade" returned: 0 in 0.827s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-249f047d-68ce-4936-9ddf-31ee1bcffade" released by "delete_volume" :: held 2.245s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:49 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7" returned: 0 in 0.854s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:49 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7 is being set with open permissions: ugo+rw
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:49 devstack sudo[102527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7
Jul 03 13:04:49 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Created reservations ['2b3b2f10-5c84-4b54-a93d-a0c9914c2647', '074c5572-ff3c-4d65-80ee-9feb5630cb0c', 'b58acec8-475d-49ab-a8f7-e9447ccb8cb0', '216688ba-9bb7-42bd-b1f5-11c80b336d77'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:49 devstack sudo[102529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:49 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:49 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2b21c86d-f203-4a25-9edb-8c72794dd878" returned: 0 in 0.743s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Lock "cinder-quobyte-2b21c86d-f203-4a25-9edb-8c72794dd878" released by "delete_volume" :: held 1.925s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Created reservations ['31d57ae4-2612-4449-8fb5-5792dc262722', '7f7b501d-45b5-4e8c-abc8-9abae2261d7b', '5b91270f-20b2-4ba1-8407-37016b03994f', 'a83ebe2b-1926-4135-a65d-6d4f63fcf6ab'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:50 devstack sudo[102532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:50 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:50 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7" returned: 0 in 0.848s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:50 devstack sudo[102537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.info
Jul 03 13:04:50 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:50 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.834s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Deleted volume successfully.
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65404bd2-0198-4b1c-aca8-575935619a43 tempest-VolumesGetTest-1222645544 None] Lock "cinder-249f047d-68ce-4936-9ddf-31ee1bcffade-delete_volume" released by "delete_volume" :: held 3.484s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-a8cf41f8-7e88-4772-8a29-65a4621bb394-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Lock "cinder-a8cf41f8-7e88-4772-8a29-65a4621bb394-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-quobyte-a8cf41f8-7e88-4772-8a29-65a4621bb394" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-a8cf41f8-7e88-4772-8a29-65a4621bb394" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:50 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Flow 'volume_create_manager' (50101532-69dd-474c-8d14-f1b90e2f67a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9ffbdb-b12d-400f-b7d1-c90a33a82b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[98248d48-d752-4306-a217-858f602492cd]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9ffbdb-b12d-400f-b7d1-c90a33a82b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760033531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee486d34-8cd1-47e7-8f48-7256576a551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafc5dc00a984ed5a47f8730af8be9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:51Z,use_quota=True,user_id='4581649a13714520b30b2d8fdcc7e7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6bffd7-8873-4ea8-9713-8287523c693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6bffd7-8873-4ea8-9713-8287523c693c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d1894e-d1e0-4819-8222-7c2d930ec312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d1894e-d1e0-4819-8222-7c2d930ec312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee486d34-8cd1-47e7-8f48-7256576a551f', 'volume_name': 'volume-ee486d34-8cd1-47e7-8f48-7256576a551f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2064ad-2532-4ff5-9ea5-a30de3541b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2064ad-2532-4ff5-9ea5-a30de3541b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3b19c0-2ce2-4097-a9dc-6a5209f64b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:51 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Volume ee486d34-8cd1-47e7-8f48-7256576a551f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee486d34-8cd1-47e7-8f48-7256576a551f', 'volume_size': 1}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:51 devstack sudo[102540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394
Jul 03 13:04:51 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:51 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.122s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Deleted volume successfully.
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-075581ea-ec1b-4bdc-b5dd-a49af28f5285 tempest-ProjectReaderTests-1761140788 None] Lock "cinder-2b21c86d-f203-4a25-9edb-8c72794dd878-delete_volume" released by "delete_volume" :: held 3.378s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:51 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.info" returned: 0 in 0.959s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:51 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.info is being set with open permissions: ugo+rw
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:51 devstack sudo[102543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.info
Jul 03 13:04:51 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:51 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394" returned: 0 in 0.876s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:51 devstack sudo[102548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394
Jul 03 13:04:51 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:52 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.info" returned: 0 in 0.733s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.116s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.089s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760033531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee486d34-8cd1-47e7-8f48-7256576a551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafc5dc00a984ed5a47f8730af8be9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:51Z,use_quota=True,user_id='4581649a13714520b30b2d8fdcc7e7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Creating volume ee486d34-8cd1-47e7-8f48-7256576a551f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:52 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:52 devstack sudo[102551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f 1073741824
Jul 03 13:04:52 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7ef87c21-386d-43b5-a2f9-ef0982ab9666 tempest-VolumesDeleteCascade-600258318 None] Create snapshot completed successfully
Jul 03 13:04:52 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a8cf41f8-7e88-4772-8a29-65a4621bb394" returned: 0 in 0.715s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-a8cf41f8-7e88-4772-8a29-65a4621bb394" released by "delete_volume" :: held 1.694s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Created reservations ['231eb4f7-f756-49bb-81f1-df296ccea3dc', '5a606a76-bc7a-49fc-a593-efca5491059f', '1d70c3f2-b34b-404a-86f6-225b5170fda0', '5e1304c5-f782-41e4-8ee3-ee8e91f19c4d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:52 devstack sudo[102554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:52 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:53 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f 1073741824" returned: 0 in 1.067s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:53 devstack sudo[102559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f
Jul 03 13:04:53 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:53 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.961s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Deleted volume successfully.
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4887584e-29bc-459e-9566-aa9c9b33346e tempest-VolumesGetTest-1222645544 None] Lock "cinder-a8cf41f8-7e88-4772-8a29-65a4621bb394-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Flow 'volume_create_manager' (fb6ff0e7-b2e3-49da-9cdf-d3318ca0bb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103a3c95-719a-4eb6-a48c-64b2fe7174a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103a3c95-719a-4eb6-a48c-64b2fe7174a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1146720756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc49c1d9-c453-409e-b23f-2eac5ed90013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9153792b0b45d58245258f2ed18f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8fc21094-10d6-4edf-b773-7f03524a00a7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:54Z,use_quota=True,user_id='e07dd503fd3d4ac0948b107a87ab76ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f782db1c-e004-4505-8c08-58516d3fc73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f782db1c-e004-4505-8c08-58516d3fc73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ecc70d-321a-425d-b9da-29f87be8b0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ecc70d-321a-425d-b9da-29f87be8b0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc49c1d9-c453-409e-b23f-2eac5ed90013', 'volume_name': 'volume-fc49c1d9-c453-409e-b23f-2eac5ed90013', 'volume_size': 1, 'snapshot_id': '8fc21094-10d6-4edf-b773-7f03524a00a7'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6520a9ab-bb0a-4a8c-a265-9109275c4384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6520a9ab-bb0a-4a8c-a265-9109275c4384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b8fb49-9d5d-4c7b-9f65-b1a3d9b62d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Volume fc49c1d9-c453-409e-b23f-2eac5ed90013: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc49c1d9-c453-409e-b23f-2eac5ed90013', 'volume_size': 1, 'snapshot_id': '8fc21094-10d6-4edf-b773-7f03524a00a7'}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (d06aa874-612c-4afa-bb55-35e1e1d5fe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0a0219-fc99-40ca-a102-e745135f0f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0a0219-fc99-40ca-a102-e745135f0f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1694068624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41563dd8-ecb1-4752-a9af-1d9b713d6bd2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:54Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8542d888-313e-4a49-8c18-1dff594b8e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8542d888-313e-4a49-8c18-1dff594b8e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e52e62-40b8-4a3d-89da-3ddad8d89c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:04:54 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f" returned: 0 in 0.942s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.295s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-quobyte-8fc21094-10d6-4edf-b773-7f03524a00a7-fc49c1d9-c453-409e-b23f-2eac5ed90013" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-8fc21094-10d6-4edf-b773-7f03524a00a7-fc49c1d9-c453-409e-b23f-2eac5ed90013" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Creating volume fc49c1d9-c453-409e-b23f-2eac5ed90013 from snapshot 8fc21094-10d6-4edf-b773-7f03524a00a7 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-quobyte-fc49c1d9-c453-409e-b23f-2eac5ed90013" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3b19c0-2ce2-4097-a9dc-6a5209f64b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee486d34-8cd1-47e7-8f48-7256576a551f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cad5e9e-c044-4a4f-9f11-43c3c88a705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-fc49c1d9-c453-409e-b23f-2eac5ed90013" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] snapshot: 8fc21094-10d6-4edf-b773-7f03524a00a7, volume: fc49c1d9-c453-409e-b23f-2eac5ed90013,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:04:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Volume volume-ee486d34-8cd1-47e7-8f48-7256576a551f (ee486d34-8cd1-47e7-8f48-7256576a551f): created successfully
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cad5e9e-c044-4a4f-9f11-43c3c88a705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Flow 'volume_create_manager' (50101532-69dd-474c-8d14-f1b90e2f67a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-eb7073ab-76a4-42df-930b-387be5571107 tempest-ProjectReaderTests-1761140788 None] Created volume successfully.
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5184cf-5a3f-48a3-8226-a382882642ac]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e52e62-40b8-4a3d-89da-3ddad8d89c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41563dd8-ecb1-4752-a9af-1d9b713d6bd2', 'volume_name': 'volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273abfec200>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ae9384-125c-484f-913f-212dac6f47e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:54 devstack sudo[102563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7
Jul 03 13:04:54 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ae9384-125c-484f-913f-212dac6f47e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744103af-dd5b-4e82-a8b9-fb88994ba3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:54 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Volume 41563dd8-ecb1-4752-a9af-1d9b713d6bd2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273abfec200>}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Trying to clone 41563dd8-ecb1-4752-a9af-1d9b713d6bd2 from image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jul 03 13:04:54 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jul 03 13:04:54 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[efab1192-073a-4920-93e9-1246feaf49da]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:55 devstack sudo[102566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD
Jul 03 13:04:55 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Acquiring lock "cinder-ee486d34-8cd1-47e7-8f48-7256576a551f-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Lock "cinder-ee486d34-8cd1-47e7-8f48-7256576a551f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Acquiring lock "cinder-quobyte-ee486d34-8cd1-47e7-8f48-7256576a551f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Lock "cinder-quobyte-ee486d34-8cd1-47e7-8f48-7256576a551f" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e1b3f6-873b-4bd5-bfe8-8c67936b8ce0]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:55 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7" returned: 0 in 0.947s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[70670764-c241-4f90-9aa2-652be002c40e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:55 devstack sudo[102572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f
Jul 03 13:04:55 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:55 devstack sudo[102574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26
Jul 03 13:04:55 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:55 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD" returned: 0 in 0.812s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Temporary image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 is fetched for user fbec2ce2957e404abb1e3303bd4efec1. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[544034c4-146b-44f5-9581-25bdd5d91432]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:56 devstack sudo[102580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD
Jul 03 13:04:56 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:56 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f" returned: 0 in 0.861s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:56 devstack sudo[102588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f
Jul 03 13:04:56 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:56 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" returned: 0 in 0.840s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:56 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 13:04:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:56 devstack sudo[102590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013
Jul 03 13:04:56 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:56 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD" returned: 0 in 0.844s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:56 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ee486d34-8cd1-47e7-8f48-7256576a551f" returned: 0 in 0.752s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Lock "cinder-quobyte-ee486d34-8cd1-47e7-8f48-7256576a551f" released by "delete_volume" :: held 1.674s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:57 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Created reservations ['3137de55-d670-434d-ba03-77eac3e04851', '4fb20efd-f858-4c3c-abcc-a67575775556', '6dcda517-e4f5-4047-b012-998bd6485e5d', '4c3936d1-6938-4207-97f3-398a267b530a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:57 devstack sudo[102600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:04:57 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:58 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.064s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:58 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:04:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Deleted volume successfully.
Jul 03 13:04:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-626a30f3-f298-40c9-8a3c-e5ef2cf5414a tempest-ProjectReaderTests-1761140788 None] Lock "cinder-ee486d34-8cd1-47e7-8f48-7256576a551f-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:02 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013" returned: 0 in 5.754s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a830a78-15fc-4351-a291-ecd88a24cdff]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:02 devstack sudo[102653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26
Jul 03 13:05:02 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:03 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" returned: 0 in 1.032s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:05:03 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Converted 1024.00 MB image at 177.83 MB/s
Jul 03 13:05:03 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013 is being set with open permissions: ugo+rw
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:03 devstack sudo[102658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013
Jul 03 13:05:03 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:03 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013" returned: 0 in 0.669s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-fc49c1d9-c453-409e-b23f-2eac5ed90013" released by "_copy_volume_from_snapshot" :: held 9.387s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-8fc21094-10d6-4edf-b773-7f03524a00a7-fc49c1d9-c453-409e-b23f-2eac5ed90013" released by "_create_volume_from_snapshot" :: held 9.438s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.460s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1694068624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41563dd8-ecb1-4752-a9af-1d9b713d6bd2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:54Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Creating volume 41563dd8-ecb1-4752-a9af-1d9b713d6bd2 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:03 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:03 devstack sudo[102661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 1073741824
Jul 03 13:05:03 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b8fb49-9d5d-4c7b-9f65-b1a3d9b62d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc49c1d9-c453-409e-b23f-2eac5ed90013', 'volume_size': 1, 'snapshot_id': '8fc21094-10d6-4edf-b773-7f03524a00a7'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcd82af-2250-47c4-a751-4fede2b95950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Volume volume-fc49c1d9-c453-409e-b23f-2eac5ed90013 (fc49c1d9-c453-409e-b23f-2eac5ed90013): created successfully
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcd82af-2250-47c4-a751-4fede2b95950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Flow 'volume_create_manager' (fb6ff0e7-b2e3-49da-9cdf-d3318ca0bb53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fe84b3c1-be57-49d7-a090-920b479dc986 tempest-VolumesDeleteCascade-600258318 None] Created volume successfully.
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Performing cascade delete. {{(pid=86763) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-8fc21094-10d6-4edf-b773-7f03524a00a7-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-8fc21094-10d6-4edf-b773-7f03524a00a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-quobyte-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-quobyte-8fc21094-10d6-4edf-b773-7f03524a00a7" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-8fc21094-10d6-4edf-b773-7f03524a00a7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Deleting offline snapshot 8fc21094-10d6-4edf-b773-7f03524a00a7 of volume 0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] snapshot_file for this snap is: volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccc4ff8-e712-47bf-9548-c0c7022e2240]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:04 devstack sudo[102671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7
Jul 03 13:05:04 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Flow 'volume_create_manager' (8cc2cb30-24d3-46ae-8fec-0452b0ef2da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4495e023-ed5c-4141-93b8-edeebc3dc708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4495e023-ed5c-4141-93b8-edeebc3dc708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263829783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2112009e-c7bb-45d8-91cd-45bf8eeb3c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc11a185dcf3492b8da33992547d8cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:05Z,use_quota=True,user_id='d4fa5cb6393d46c6acc94dca0fd6ff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf6cce1-2ccb-4c9c-b4b3-cf6d0d8e1511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf6cce1-2ccb-4c9c-b4b3-cf6d0d8e1511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd536a09-de90-484b-8d09-4f33568b264a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd536a09-de90-484b-8d09-4f33568b264a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2112009e-c7bb-45d8-91cd-45bf8eeb3c7e', 'volume_name': 'volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f939ffc-d1b3-41cf-b98c-ec2fd9667f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f939ffc-d1b3-41cf-b98c-ec2fd9667f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4fb7546-4f9a-45c0-92f0-5848162f0d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Volume 2112009e-c7bb-45d8-91cd-45bf8eeb3c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e', 'volume_size': 1}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:04 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 1073741824" returned: 0 in 1.173s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:05 devstack sudo[102675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2
Jul 03 13:05:05 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:05 devstack sudo[102677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:05:05 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:05 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7" returned: 0 in 1.034s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd919fe5-719b-42b7-9cb1-39c9abe5074c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:05 devstack sudo[102682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26
Jul 03 13:05:05 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:05 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2" returned: 0 in 0.823s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263829783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2112009e-c7bb-45d8-91cd-45bf8eeb3c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc11a185dcf3492b8da33992547d8cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:05Z,use_quota=True,user_id='d4fa5cb6393d46c6acc94dca0fd6ff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Creating volume 2112009e-c7bb-45d8-91cd-45bf8eeb3c7e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:05 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:05 devstack sudo[102686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e 1073741824
Jul 03 13:05:05 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:05 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Attempting download of 8af9b126-5566-44ac-8948-4fb0a1be3fd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}])) to volume 41563dd8-ecb1-4752-a9af-1d9b713d6bd2. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.856s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f101f1-5065-4cab-a18b-23b8839165bd]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_oxu7go_o {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:06 devstack sudo[102688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_oxu7go_o
Jul 03 13:05:06 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:06 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" returned: 0 in 1.093s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:06 devstack sudo[102696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7
Jul 03 13:05:06 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:06 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_oxu7go_o" returned: 0 in 0.979s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_oxu7go_o {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:06 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e 1073741824" returned: 0 in 1.131s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:07 devstack sudo[102701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e
Jul 03 13:05:07 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:07 devstack sudo[102700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_oxu7go_o
Jul 03 13:05:07 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:07 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7" returned: 0 in 0.998s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:07 devstack sudo[102708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7
Jul 03 13:05:07 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:07 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e" returned: 0 in 0.758s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4fb7546-4f9a-45c0-92f0-5848162f0d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4603b2bd-f870-4d46-8014-aaba7b088918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Volume volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e (2112009e-c7bb-45d8-91cd-45bf8eeb3c7e): created successfully
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4603b2bd-f870-4d46-8014-aaba7b088918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Flow 'volume_create_manager' (8cc2cb30-24d3-46ae-8fec-0452b0ef2da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e5f5e687-fb00-4307-85f0-83eb367b336d tempest-ProjectReaderTests-1760194253 None] Created volume successfully.
Jul 03 13:05:07 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_oxu7go_o" returned: 1 in 0.987s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_oxu7go_o' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c429f401-f63b-43f8-aab4-52d999b3b6d6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:08 devstack sudo[102712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD
Jul 03 13:05:08 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "cinder-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "cinder-quobyte-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-quobyte-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[225977b9-7946-4ab3-a192-a53923874300]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:08 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:08 devstack sudo[102715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e
Jul 03 13:05:08 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26.8fc21094-10d6-4edf-b773-7f03524a00a7" returned: 0 in 0.901s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-8fc21094-10d6-4edf-b773-7f03524a00a7" released by "_delete_snapshot" :: held 4.165s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" released by "delete_snapshot" :: held 4.198s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Created reservations ['c1214cdc-4e55-4764-9e77-dadfc15ed366', '0461d484-d1cf-4c0c-bc26-41f3d2110981', '580f2cc4-74ed-48e5-a8a2-7efc37aa0f0e', '4a8b6402-51e7-4465-985f-aaa5c1268f12'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Delete snapshot completed successfully.
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-8fc21094-10d6-4edf-b773-7f03524a00a7-delete_snapshot" released by "delete_snapshot" :: held 4.475s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Snapshots deleted, issuing volume delete {{(pid=86763) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-quobyte-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:08 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD" returned: 0 in 0.978s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] 8af9b126-5566-44ac-8948-4fb0a1be3fd3 was qcow2, converting to raw {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eec05d-2e44-4253-ba01-55c7dba1d4db]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:08 devstack sudo[102720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2
Jul 03 13:05:08 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:09 devstack sudo[102721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26
Jul 03 13:05:09 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:09 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e" returned: 0 in 0.974s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:09 devstack sudo[102727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e
Jul 03 13:05:09 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:09 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" returned: 0 in 0.945s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:09 devstack sudo[102738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26
Jul 03 13:05:09 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:10 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e" returned: 0 in 0.897s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-quobyte-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e" released by "delete_volume" :: held 1.926s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Created reservations ['74d19b5d-d609-4796-ba6c-2fad82e3df35', 'd3c71b22-1733-4c57-a173-3a2cca05e32c', '69470356-ee13-4590-8576-f05e0dd430bf', '54573095-5e6b-42cb-a1ca-5257aa99412f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:10 devstack sudo[102742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:05:10 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:10 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" returned: 0 in 0.866s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26" released by "delete_volume" :: held 1.910s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Created reservations ['fbc22e29-752f-485b-8224-928bddf4afae', '517b245a-e363-4901-821d-3208c00032d9', 'a8598d01-62b3-4090-a605-264614d162e1', 'b2b734a3-29a1-405b-9ef8-a950d2a7125d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:11 devstack sudo[102745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:05:11 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Flow 'volume_create_manager' (1782da84-a91f-4602-864f-6ae1d5feb7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff99fbaa-6483-4c5a-b140-0dfab14e78bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff99fbaa-6483-4c5a-b140-0dfab14e78bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758458094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3720736d-06e4-400a-8085-2860d822f24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc11a185dcf3492b8da33992547d8cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:11Z,use_quota=True,user_id='d4fa5cb6393d46c6acc94dca0fd6ff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1abf78-c8ee-48c3-ac3c-04cba0f7b30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1abf78-c8ee-48c3-ac3c-04cba0f7b30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3499bbb-bd9d-41be-9004-85b54f208035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3499bbb-bd9d-41be-9004-85b54f208035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3720736d-06e4-400a-8085-2860d822f24c', 'volume_name': 'volume-3720736d-06e4-400a-8085-2860d822f24c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddaca6a-b118-4d7b-a8e2-024314970c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:11 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddaca6a-b118-4d7b-a8e2-024314970c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d7893d-983f-42f2-91d0-241b1f012ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Volume 3720736d-06e4-400a-8085-2860d822f24c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3720736d-06e4-400a-8085-2860d822f24c', 'volume_size': 1}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758458094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3720736d-06e4-400a-8085-2860d822f24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc11a185dcf3492b8da33992547d8cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:11Z,use_quota=True,user_id='d4fa5cb6393d46c6acc94dca0fd6ff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Creating volume 3720736d-06e4-400a-8085-2860d822f24c {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:11 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:11 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.042s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2" returned: 0 in 2.651s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_gi6ekumodevstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:05:11 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Converted 112.00 MB image at 42.23 MB/s
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:11 devstack sudo[102748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c 1073741824
Jul 03 13:05:11 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Deleted volume successfully.
Jul 03 13:05:11 devstack sudo[102749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 1G
Jul 03 13:05:11 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77f02c07-82a1-411e-9206-2161ed355897 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-2112009e-c7bb-45d8-91cd-45bf8eeb3c7e-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:11 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.934s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:05:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Deleted volume successfully.
Jul 03 13:05:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f7ac010f-d68d-4eed-aa99-f9f7a666a03f tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-0ef46cc1-fc65-4cf1-ab23-9046a10c3c26-delete_volume" released by "delete_volume" :: held 7.727s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-fc49c1d9-c453-409e-b23f-2eac5ed90013-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-fc49c1d9-c453-409e-b23f-2eac5ed90013-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "cinder-quobyte-fc49c1d9-c453-409e-b23f-2eac5ed90013" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-fc49c1d9-c453-409e-b23f-2eac5ed90013" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[db632657-ebe4-4391-ab55-bf68b32276e3]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:12 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 1G" returned: 0 in 0.912s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:12 devstack sudo[102759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013
Jul 03 13:05:12 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc16669-696d-443e-8965-acae497b025e]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:12 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c 1073741824" returned: 0 in 1.059s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:12 devstack sudo[102762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2
Jul 03 13:05:12 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:12 devstack sudo[102763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c
Jul 03 13:05:12 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:13 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013" returned: 0 in 1.112s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:13 devstack sudo[102773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013
Jul 03 13:05:13 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:13 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c" returned: 0 in 0.836s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:05:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:13 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2" returned: 0 in 0.975s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d7893d-983f-42f2-91d0-241b1f012ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3720736d-06e4-400a-8085-2860d822f24c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f5d603-84bb-4b75-8a07-e55515fb3f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:13 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Volume volume-3720736d-06e4-400a-8085-2860d822f24c (3720736d-06e4-400a-8085-2860d822f24c): created successfully
Jul 03 13:05:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f5d603-84bb-4b75-8a07-e55515fb3f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Flow 'volume_create_manager' (1782da84-a91f-4602-864f-6ae1d5feb7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3bc084b3-4d60-4cf9-bd98-149d230b2b06 tempest-ProjectReaderTests-1760194253 None] Created volume successfully.
Jul 03 13:05:13 devstack sudo[102775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2
Jul 03 13:05:13 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:14 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-fc49c1d9-c453-409e-b23f-2eac5ed90013" returned: 0 in 0.750s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-quobyte-fc49c1d9-c453-409e-b23f-2eac5ed90013" released by "delete_volume" :: held 1.929s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Created reservations ['42cc3d0c-61d0-4922-9200-543852651be5', '4cbc9f98-d65f-4830-9c83-8244b5a3775e', '0a7b85d4-8ee3-4c41-9302-09f44c29582b', '510850f2-e59f-49b1-8441-75bbb04e917d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:14 devstack sudo[102781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:05:14 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:14 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2" returned: 1 in 1.011s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Downloaded image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}])) to volume 41563dd8-ecb1-4752-a9af-1d9b713d6bd2 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Temporary image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 for user fbec2ce2957e404abb1e3303bd4efec1 is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Marking volume 41563dd8-ecb1-4752-a9af-1d9b713d6bd2 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Copying metadata from image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 to 41563dd8-ecb1-4752-a9af-1d9b713d6bd2. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Creating volume glance metadata for volume 41563dd8-ecb1-4752-a9af-1d9b713d6bd2 backed by image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744103af-dd5b-4e82-a8b9-fb88994ba3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273abfec200>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ff145e-5649-4fb5-920d-af6401c7e6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:14 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Volume volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 (41563dd8-ecb1-4752-a9af-1d9b713d6bd2): created successfully
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ff145e-5649-4fb5-920d-af6401c7e6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (d06aa874-612c-4afa-bb55-35e1e1d5fe3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "cinder-3720736d-06e4-400a-8085-2860d822f24c-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-eb5d84d8-19c7-4141-856a-dc74a90c0e89 tempest-VolumesGetTest-1222645544 None] Created volume successfully.
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-3720736d-06e4-400a-8085-2860d822f24c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "cinder-quobyte-3720736d-06e4-400a-8085-2860d822f24c" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-quobyte-3720736d-06e4-400a-8085-2860d822f24c" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a12186-6c9c-494a-93af-698305cc2883]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:15 devstack sudo[102783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c
Jul 03 13:05:15 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:15 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.923s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:15 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:05:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Deleted volume successfully.
Jul 03 13:05:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9ead0138-f86f-4e22-be4b-bd51753979f7 tempest-VolumesDeleteCascade-600258318 None] Lock "cinder-fc49c1d9-c453-409e-b23f-2eac5ed90013-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:05:16 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (96d46aad-f8df-4911-b29f-acae3e16b988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c716fd7f-a5ce-43d4-817b-9113c15bd4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c" returned: 0 in 1.234s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c716fd7f-a5ce-43d4-817b-9113c15bd4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-262349784',display_name='tempest-VolumesGetTest-Volume-1654073281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94dadada-6f9c-4e64-980b-471f52573ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:16Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:16 devstack sudo[102790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c
Jul 03 13:05:16 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa08b8b1-c5fb-4d66-9b1d-35291c83d3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa08b8b1-c5fb-4d66-9b1d-35291c83d3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a4fbfb-cd59-4672-b1e5-9afce9ced247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a4fbfb-cd59-4672-b1e5-9afce9ced247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94dadada-6f9c-4e64-980b-471f52573ae7', 'volume_name': 'volume-94dadada-6f9c-4e64-980b-471f52573ae7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edd940d-3c37-4d49-9b76-062cc9129f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edd940d-3c37-4d49-9b76-062cc9129f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4a0ccb-c53a-4586-9129-208e4dcef882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:16 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Volume 94dadada-6f9c-4e64-980b-471f52573ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94dadada-6f9c-4e64-980b-471f52573ae7', 'volume_size': 1}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-262349784',display_name='tempest-VolumesGetTest-Volume-1654073281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94dadada-6f9c-4e64-980b-471f52573ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='207218f2e6b44480a5153046150fdd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:16Z,use_quota=True,user_id='fbec2ce2957e404abb1e3303bd4efec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Creating volume 94dadada-6f9c-4e64-980b-471f52573ae7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:16 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:05:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:16 devstack sudo[102792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7 1073741824
Jul 03 13:05:16 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:17 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3720736d-06e4-400a-8085-2860d822f24c" returned: 0 in 0.910s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-quobyte-3720736d-06e4-400a-8085-2860d822f24c" released by "delete_volume" :: held 2.208s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:17 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Created reservations ['699e6b6e-6400-4715-aff4-64f90aa6fd52', '8d3a5ba7-f401-49ba-9011-bd357e0d6771', '06d749e8-47db-42d6-91ac-5873e268c884', '14f3ff51-454a-4a86-95c2-d1a6d4aa69b1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:17 devstack sudo[102799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:05:17 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:17 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7 1073741824" returned: 0 in 1.141s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:17 devstack sudo[102801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7
Jul 03 13:05:17 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:18 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.837s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:05:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Deleted volume successfully.
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0ca97d6b-4433-4592-83d3-d821e2385050 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-3720736d-06e4-400a-8085-2860d822f24c-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:18 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7" returned: 0 in 0.843s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4a0ccb-c53a-4586-9129-208e4dcef882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94dadada-6f9c-4e64-980b-471f52573ae7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac525d4-9879-4168-a131-3580c659cf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Volume volume-94dadada-6f9c-4e64-980b-471f52573ae7 (94dadada-6f9c-4e64-980b-471f52573ae7): created successfully
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac525d4-9879-4168-a131-3580c659cf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Flow 'volume_create_manager' (96d46aad-f8df-4911-b29f-acae3e16b988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4a719b2e-100a-4868-9b80-f9e2f23868d9 tempest-VolumesGetTest-1222645544 None] Created volume successfully.
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Flow 'volume_create_manager' (cab5917e-d497-4e68-adb5-253f65959e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190794fc-5d0c-4d0c-9a2c-bed853fbd097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190794fc-5d0c-4d0c-9a2c-bed853fbd097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720296795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838be921-b531-4980-b90c-d9a69aa56853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc11a185dcf3492b8da33992547d8cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:19Z,use_quota=True,user_id='d4fa5cb6393d46c6acc94dca0fd6ff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c23cec-951d-45a3-a5f5-120ce74da8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c23cec-951d-45a3-a5f5-120ce74da8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16814eee-32fa-44ab-81a0-f3ca76ffe6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16814eee-32fa-44ab-81a0-f3ca76ffe6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '838be921-b531-4980-b90c-d9a69aa56853', 'volume_name': 'volume-838be921-b531-4980-b90c-d9a69aa56853', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048d710b-7052-4e75-b993-465d37723a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048d710b-7052-4e75-b993-465d37723a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be23a35-e552-4a43-8b1a-9a958efc3019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Volume 838be921-b531-4980-b90c-d9a69aa56853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-838be921-b531-4980-b90c-d9a69aa56853', 'volume_size': 1}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720296795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838be921-b531-4980-b90c-d9a69aa56853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc11a185dcf3492b8da33992547d8cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:19Z,use_quota=True,user_id='d4fa5cb6393d46c6acc94dca0fd6ff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Creating volume 838be921-b531-4980-b90c-d9a69aa56853 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:18 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:05:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:18 devstack sudo[102805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853 1073741824
Jul 03 13:05:18 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-94dadada-6f9c-4e64-980b-471f52573ae7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Lock "cinder-94dadada-6f9c-4e64-980b-471f52573ae7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-quobyte-94dadada-6f9c-4e64-980b-471f52573ae7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-94dadada-6f9c-4e64-980b-471f52573ae7" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb344a2-85ce-4b9f-8a2a-169c59bbd396]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:19 devstack sudo[102810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7
Jul 03 13:05:19 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:20 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853 1073741824" returned: 0 in 1.164s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:20 devstack sudo[102813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853
Jul 03 13:05:20 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:20 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7" returned: 0 in 0.901s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:20 devstack sudo[102819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7
Jul 03 13:05:20 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Flow 'volume_create_manager' (b3c0e52b-14b8-4719-beab-bc2c4fb9a004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779105b0-38bf-4598-8b82-3d5f1f1106fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:20 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853" returned: 0 in 0.849s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779105b0-38bf-4598-8b82-3d5f1f1106fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1242243422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0310bf5-0529-4120-9b80-6dbad3e2af4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe98d4205674b258c86ae58bd5ba332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:21Z,use_quota=True,user_id='fd317eab0a624be4bced30c78ad2faa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19df06d-7a84-4c78-ab4c-79d765fc5402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19df06d-7a84-4c78-ab4c-79d765fc5402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8b3476-31d4-4e30-ae0b-5201ee06df0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8b3476-31d4-4e30-ae0b-5201ee06df0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0310bf5-0529-4120-9b80-6dbad3e2af4d', 'volume_name': 'volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f91081-71af-4543-87e9-e6aec5d88ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f91081-71af-4543-87e9-e6aec5d88ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5c343c-e409-454e-a7d6-f088ffd111e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:21 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Volume c0310bf5-0529-4120-9b80-6dbad3e2af4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d', 'volume_size': 1}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1242243422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0310bf5-0529-4120-9b80-6dbad3e2af4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe98d4205674b258c86ae58bd5ba332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:21Z,use_quota=True,user_id='fd317eab0a624be4bced30c78ad2faa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Creating volume c0310bf5-0529-4120-9b80-6dbad3e2af4d {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:21 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be23a35-e552-4a43-8b1a-9a958efc3019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-838be921-b531-4980-b90c-d9a69aa56853', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fabbb17-61b1-4f73-8029-922f2674f875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:21 devstack sudo[102822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d 1073741824
Jul 03 13:05:21 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:21 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Volume volume-838be921-b531-4980-b90c-d9a69aa56853 (838be921-b531-4980-b90c-d9a69aa56853): created successfully
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fabbb17-61b1-4f73-8029-922f2674f875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Flow 'volume_create_manager' (cab5917e-d497-4e68-adb5-253f65959e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-642d8f9a-8306-49c8-b47e-85a5594ef6f9 tempest-ProjectReaderTests-1760194253 None] Created volume successfully.
Jul 03 13:05:21 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-94dadada-6f9c-4e64-980b-471f52573ae7" returned: 0 in 0.803s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-94dadada-6f9c-4e64-980b-471f52573ae7" released by "delete_volume" :: held 1.762s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Created reservations ['f93ef037-490d-427e-b9d9-871dd234ce6e', 'bd974c6e-e700-4c90-b727-46ef090d1106', '283e28d6-a8f8-449d-b126-368b85910e82', 'fd70cdcc-5534-4cc7-a448-519a94098857'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:21 devstack sudo[102825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:05:21 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-41563dd8-ecb1-4752-a9af-1d9b713d6bd2-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Lock "cinder-41563dd8-ecb1-4752-a9af-1d9b713d6bd2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:22 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d 1073741824" returned: 0 in 1.054s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Acquiring lock "cinder-quobyte-41563dd8-ecb1-4752-a9af-1d9b713d6bd2" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-41563dd8-ecb1-4752-a9af-1d9b713d6bd2" acquired by "delete_volume" :: waited 0.040s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:22 devstack sudo[102830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d
Jul 03 13:05:22 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "cinder-838be921-b531-4980-b90c-d9a69aa56853-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b113412-4e08-49de-b415-1e34af037119]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-838be921-b531-4980-b90c-d9a69aa56853-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "cinder-quobyte-838be921-b531-4980-b90c-d9a69aa56853" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-quobyte-838be921-b531-4980-b90c-d9a69aa56853" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:22 devstack sudo[102832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2
Jul 03 13:05:22 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6148f991-3c15-4fd6-b41a-7531abef7f61]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:22 devstack sudo[102835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853
Jul 03 13:05:22 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:22 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.019s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:05:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Deleted volume successfully.
Jul 03 13:05:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8639ab61-2fde-4189-a7c1-1c826ec373c4 tempest-VolumesGetTest-1222645544 None] Lock "cinder-94dadada-6f9c-4e64-980b-471f52573ae7-delete_volume" released by "delete_volume" :: held 3.049s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:23 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d" returned: 0 in 0.901s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:05:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5c343c-e409-454e-a7d6-f088ffd111e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dc491b-0170-47e2-93db-f8619c5947be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Volume volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d (c0310bf5-0529-4120-9b80-6dbad3e2af4d): created successfully
Jul 03 13:05:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dc491b-0170-47e2-93db-f8619c5947be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Flow 'volume_create_manager' (b3c0e52b-14b8-4719-beab-bc2c4fb9a004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-002b423c-ad40-4e89-be64-98606ae4baa2 tempest-VolumesTransfersV355Test-2132463306 None] Created volume successfully.
Jul 03 13:05:23 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2" returned: 0 in 0.965s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:23 devstack sudo[102840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2
Jul 03 13:05:23 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:23 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853" returned: 0 in 0.996s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:23 devstack sudo[102845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853
Jul 03 13:05:23 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:24 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2" returned: 1 in 0.824s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:24 devstack sudo[102850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2
Jul 03 13:05:24 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:24 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-838be921-b531-4980-b90c-d9a69aa56853" returned: 0 in 0.772s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-quobyte-838be921-b531-4980-b90c-d9a69aa56853" released by "delete_volume" :: held 1.830s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Created reservations ['9adeaf0e-9a2d-4443-99c4-a2344c9c4b7b', '511a0faa-77a7-4928-9fce-d4eafe1a0852', '4fbd136e-a2c3-4cb3-aaa1-b386dd0abac8', '7c5f3e1c-c560-4270-80a4-000fccb0af54'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:24 devstack sudo[102853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:05:24 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:24 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-41563dd8-ecb1-4752-a9af-1d9b713d6bd2" returned: 0 in 0.942s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ba618855-f196-47a8-9e32-a5ee754ef3e8 tempest-VolumesTransfersV355Test-47322273 None] Transfer volume completed successfully.
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Lock "cinder-quobyte-41563dd8-ecb1-4752-a9af-1d9b713d6bd2" released by "delete_volume" :: held 2.859s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Created reservations ['825bced9-48e1-47a8-8153-5366a0473b8f', 'caac4b84-9377-428b-8fa9-e165aa2c4c55', '25b79384-d859-4910-ba41-f6e3dd6f0c63', '1a858523-145e-4999-bf88-15fd8f9e3131'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:25 devstack sudo[102857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:05:25 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:25 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.885s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:05:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Deleted volume successfully.
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Flow 'volume_create_manager' (35fc009d-f569-4bd4-b033-d2790093a2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe39a51-62f9-442a-bfb7-ce8f32337aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-34b9ba69-2b95-4874-b813-0a0cb3220699 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-838be921-b531-4980-b90c-d9a69aa56853-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe39a51-62f9-442a-bfb7-ce8f32337aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056142466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7c9b6a-65f3-4e01-ad7c-668967f5ec48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc11a185dcf3492b8da33992547d8cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:25Z,use_quota=True,user_id='d4fa5cb6393d46c6acc94dca0fd6ff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a1cc64-015e-4997-96a1-fe4c094eec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a1cc64-015e-4997-96a1-fe4c094eec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c1014e-b939-4a9e-9e76-ea4e5ddd2493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c1014e-b939-4a9e-9e76-ea4e5ddd2493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7c9b6a-65f3-4e01-ad7c-668967f5ec48', 'volume_name': 'volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3ba818-d080-4f66-a7d2-a2883e642c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3ba818-d080-4f66-a7d2-a2883e642c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a4154d-212f-4c6d-a89c-ed0851415820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Volume 1f7c9b6a-65f3-4e01-ad7c-668967f5ec48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48', 'volume_size': 1}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056142466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7c9b6a-65f3-4e01-ad7c-668967f5ec48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc11a185dcf3492b8da33992547d8cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:25Z,use_quota=True,user_id='d4fa5cb6393d46c6acc94dca0fd6ff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Creating volume 1f7c9b6a-65f3-4e01-ad7c-668967f5ec48 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:25 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:05:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:25 devstack sudo[102859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48 1073741824
Jul 03 13:05:25 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:26 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.880s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:26 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:05:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Deleted volume successfully.
Jul 03 13:05:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-304a364b-2eb4-4008-884b-671b2dd67d5a tempest-VolumesGetTest-1222645544 None] Lock "cinder-41563dd8-ecb1-4752-a9af-1d9b713d6bd2-delete_volume" released by "delete_volume" :: held 4.106s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Acquiring lock "cinder-c0310bf5-0529-4120-9b80-6dbad3e2af4d-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Lock "cinder-c0310bf5-0529-4120-9b80-6dbad3e2af4d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Acquiring lock "cinder-quobyte-c0310bf5-0529-4120-9b80-6dbad3e2af4d" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Lock "cinder-quobyte-c0310bf5-0529-4120-9b80-6dbad3e2af4d" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b44f00-6a38-4033-9a77-693cde4abde5]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:26 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48 1073741824" returned: 0 in 1.167s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:26 devstack sudo[102866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48
Jul 03 13:05:26 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:26 devstack sudo[102865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d
Jul 03 13:05:26 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:27 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48" returned: 0 in 0.823s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:05:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a4154d-212f-4c6d-a89c-ed0851415820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b92dbc-f3b4-4b4b-bb6c-5ab9372eb953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:27 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d" returned: 0 in 1.019s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Volume volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48 (1f7c9b6a-65f3-4e01-ad7c-668967f5ec48): created successfully
Jul 03 13:05:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b92dbc-f3b4-4b4b-bb6c-5ab9372eb953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Flow 'volume_create_manager' (35fc009d-f569-4bd4-b033-d2790093a2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:27 devstack sudo[102874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d
Jul 03 13:05:27 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8fa59c2a-f362-4ccb-bec2-fd0ea10b2d32 tempest-ProjectReaderTests-1760194253 None] Created volume successfully.
Jul 03 13:05:28 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c0310bf5-0529-4120-9b80-6dbad3e2af4d" returned: 0 in 0.792s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Lock "cinder-quobyte-c0310bf5-0529-4120-9b80-6dbad3e2af4d" released by "delete_volume" :: held 1.886s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Created reservations ['49efcaf0-ec81-4956-9127-3d93aa5248fe', '015a530d-9bc9-45ad-83e5-510c15168d01', 'f50de742-7b49-432c-8126-e50bcd3bb7cd', '9840430b-d05f-4b3d-ba73-dc0d46ec173e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "cinder-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:28 devstack sudo[102877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:05:28 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "cinder-quobyte-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-quobyte-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4326fa6-596e-480d-8a8e-d793676a8de8]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:28 devstack sudo[102879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48
Jul 03 13:05:28 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:29 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.910s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:05:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Deleted volume successfully.
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2db625ad-81c8-47e6-b1c4-639f7737cfe6 tempest-VolumesTransfersV355Test-1152473145 None] Lock "cinder-c0310bf5-0529-4120-9b80-6dbad3e2af4d-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Flow 'volume_create_manager' (6c4747a9-88d9-4f71-b150-7f7420e3c8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657fcb99-47a8-4e56-9eb0-672e11905462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:29 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657fcb99-47a8-4e56-9eb0-672e11905462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-734584680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb855aea-8d83-4593-bf82-366796fa7ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe98d4205674b258c86ae58bd5ba332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:30Z,use_quota=True,user_id='fd317eab0a624be4bced30c78ad2faa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c95cf0-66f6-4cd6-9f52-36f5cdbb3b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c95cf0-66f6-4cd6-9f52-36f5cdbb3b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6944429f-9717-462f-be10-45a81dc213be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6944429f-9717-462f-be10-45a81dc213be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb855aea-8d83-4593-bf82-366796fa7ccb', 'volume_name': 'volume-cb855aea-8d83-4593-bf82-366796fa7ccb', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c606dda6-3c37-4f6a-ad36-9e285e1c6709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c606dda6-3c37-4f6a-ad36-9e285e1c6709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d1ea3d-e0cd-4652-b50a-d92bcafe5376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:29 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Volume cb855aea-8d83-4593-bf82-366796fa7ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb855aea-8d83-4593-bf82-366796fa7ccb', 'volume_size': 1}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-734584680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb855aea-8d83-4593-bf82-366796fa7ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe98d4205674b258c86ae58bd5ba332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:30Z,use_quota=True,user_id='fd317eab0a624be4bced30c78ad2faa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Creating volume cb855aea-8d83-4593-bf82-366796fa7ccb {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:29 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48" returned: 0 in 1.170s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:29 devstack sudo[102885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb 1073741824
Jul 03 13:05:29 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:05:30 devstack sudo[102886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48
Jul 03 13:05:30 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Flow 'volume_create_manager' (06de21ce-c91d-4227-844a-6231f76ba231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d130a0-9526-4765-9587-a1423b758cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d130a0-9526-4765-9587-a1423b758cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-246821547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21456c46-6f64-414d-9309-763460e25d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c833b544474046b1b0ce25f5cecf9c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:30Z,use_quota=True,user_id='eaf644d7756543fca72bdecf68f7d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17590b45-da0a-499f-ae40-e800a71cafd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17590b45-da0a-499f-ae40-e800a71cafd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b4a33b-8bb8-490a-a8df-2a5f2953c9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b4a33b-8bb8-490a-a8df-2a5f2953c9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21456c46-6f64-414d-9309-763460e25d49', 'volume_name': 'volume-21456c46-6f64-414d-9309-763460e25d49', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c186b0f-69ce-4ec0-89c4-cde27d942bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c186b0f-69ce-4ec0-89c4-cde27d942bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22731603-f292-4f65-815f-02696e9bdc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:30 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Volume 21456c46-6f64-414d-9309-763460e25d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21456c46-6f64-414d-9309-763460e25d49', 'volume_size': 1}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:30 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48" returned: 0 in 0.772s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-quobyte-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48" released by "delete_volume" :: held 2.019s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Created reservations ['07284f0c-3d35-40f4-95a0-be44fb4d9a5d', '6b1e5ebd-bc0b-495a-9065-f6723d18570d', '6bb3f590-e66e-42af-8feb-415dac7c6902', 'f369a8f1-72d5-42c1-9397-e2e6129c43ad'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:30 devstack sudo[102895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:05:30 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:30 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb 1073741824" returned: 0 in 1.032s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:31 devstack sudo[102897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb
Jul 03 13:05:31 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:31 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.898s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:05:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Deleted volume successfully.
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1d527be2-77c6-4081-9829-64d2b5949901 tempest-ProjectReaderTests-1760194253 None] Lock "cinder-1f7c9b6a-65f3-4e01-ad7c-668967f5ec48-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:31 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb" returned: 0 in 0.891s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.821s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-246821547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21456c46-6f64-414d-9309-763460e25d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c833b544474046b1b0ce25f5cecf9c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:30Z,use_quota=True,user_id='eaf644d7756543fca72bdecf68f7d35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Creating volume 21456c46-6f64-414d-9309-763460e25d49 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:31 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d1ea3d-e0cd-4652-b50a-d92bcafe5376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb855aea-8d83-4593-bf82-366796fa7ccb', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab6778e-edd2-459b-9cf4-dce9e9c55f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:31 devstack sudo[102901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49 1073741824
Jul 03 13:05:31 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:32 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Volume volume-cb855aea-8d83-4593-bf82-366796fa7ccb (cb855aea-8d83-4593-bf82-366796fa7ccb): created successfully
Jul 03 13:05:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab6778e-edd2-459b-9cf4-dce9e9c55f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Flow 'volume_create_manager' (6c4747a9-88d9-4f71-b150-7f7420e3c8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5ebec411-5abe-4d9a-ab90-4107c2565a76 tempest-VolumesTransfersV355Test-2132463306 None] Created volume successfully.
Jul 03 13:05:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Acquiring lock "cinder-cb855aea-8d83-4593-bf82-366796fa7ccb-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:33 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49 1073741824" returned: 0 in 1.135s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:33 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:INSERT=46,cinder:UPDATE=179,cinder:SELECT=128,cinder:DELETE=17 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:05:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Lock "cinder-cb855aea-8d83-4593-bf82-366796fa7ccb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Acquiring lock "cinder-quobyte-cb855aea-8d83-4593-bf82-366796fa7ccb" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:33 devstack sudo[102907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49
Jul 03 13:05:33 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Lock "cinder-quobyte-cb855aea-8d83-4593-bf82-366796fa7ccb" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[719f80b7-32e3-415b-b9dc-0b9579fbfe76]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:33 devstack sudo[102909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb
Jul 03 13:05:33 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:34 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49" returned: 0 in 1.083s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:05:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.324s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22731603-f292-4f65-815f-02696e9bdc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21456c46-6f64-414d-9309-763460e25d49', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635bb7cf-4f4b-46b6-ac80-f25cb7538f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Volume volume-21456c46-6f64-414d-9309-763460e25d49 (21456c46-6f64-414d-9309-763460e25d49): created successfully
Jul 03 13:05:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635bb7cf-4f4b-46b6-ac80-f25cb7538f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:34 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Flow 'volume_create_manager' (06de21ce-c91d-4227-844a-6231f76ba231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb" returned: 0 in 1.101s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9ed2db21-c9bf-468c-a92e-7184fcaf721e tempest-VolumesNegativeTest-588956484 None] Created volume successfully.
Jul 03 13:05:34 devstack sudo[102915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb
Jul 03 13:05:34 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:35 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cb855aea-8d83-4593-bf82-366796fa7ccb" returned: 0 in 0.975s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Lock "cinder-quobyte-cb855aea-8d83-4593-bf82-366796fa7ccb" released by "delete_volume" :: held 2.145s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:35 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=181,cinder:SELECT=123,cinder:INSERT=48,cinder:DELETE=14 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:05:35 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Created reservations ['8aacd9d9-1fbf-43ae-ac71-d7ccc074d58f', '506585de-9ca8-4ef2-85cc-203a914ced40', '05c79698-d3d5-40f6-85eb-ab67b68f1e67', 'a8d03d96-9827-436e-bd35-1f2d10144ad6'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:35 devstack sudo[102918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:05:35 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:36 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.943s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:36 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:05:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Deleted volume successfully.
Jul 03 13:05:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-88534539-4f3e-4a97-89e5-a2ba1b3ffcb4 tempest-VolumesTransfersV355Test-1152473145 None] Lock "cinder-cb855aea-8d83-4593-bf82-366796fa7ccb-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:45 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:05:46 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=8,cinder:DELETE=2,cinder:SELECT=4,cinder:INSERT=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Flow 'volume_create_manager' (1899c541-da08-44fc-96f7-524b37817fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2868b4-2fbf-43e4-b07b-042df8cc0c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2868b4-2fbf-43e4-b07b-042df8cc0c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1100680039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74255de2-e998-47ed-859f-a4cbc91fcfe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabf45a0a6c24985891c868f64e71a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:58Z,use_quota=True,user_id='9a7f31f076af43d4ba29709f006bb8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949c0095-9414-4794-8d53-0b4656408cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949c0095-9414-4794-8d53-0b4656408cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fce120d-18b1-4fbc-a906-b910d15add08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fce120d-18b1-4fbc-a906-b910d15add08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74255de2-e998-47ed-859f-a4cbc91fcfe1', 'volume_name': 'volume-74255de2-e998-47ed-859f-a4cbc91fcfe1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b4b385-12fd-4ef2-ba02-1fe4fff14cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b4b385-12fd-4ef2-ba02-1fe4fff14cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a54d70-0521-4915-b2c6-7343938216f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:58 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Volume 74255de2-e998-47ed-859f-a4cbc91fcfe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74255de2-e998-47ed-859f-a4cbc91fcfe1', 'volume_size': 1}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1100680039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74255de2-e998-47ed-859f-a4cbc91fcfe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabf45a0a6c24985891c868f64e71a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:58Z,use_quota=True,user_id='9a7f31f076af43d4ba29709f006bb8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Creating volume 74255de2-e998-47ed-859f-a4cbc91fcfe1 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:58 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:05:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:58 devstack sudo[102950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 1073741824
Jul 03 13:05:58 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:59 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 1073741824" returned: 0 in 1.194s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:59 devstack sudo[102996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1
Jul 03 13:05:59 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:00 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1" returned: 0 in 0.974s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:06:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a54d70-0521-4915-b2c6-7343938216f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74255de2-e998-47ed-859f-a4cbc91fcfe1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d98886d-671f-4135-b0c6-3dfd323ac28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:00 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Volume volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 (74255de2-e998-47ed-859f-a4cbc91fcfe1): created successfully
Jul 03 13:06:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d98886d-671f-4135-b0c6-3dfd323ac28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Flow 'volume_create_manager' (1899c541-da08-44fc-96f7-524b37817fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8d24baf0-2df3-457f-aa0d-10ddc805017e tempest-VolumesActionsTest-432203755 None] Created volume successfully.
Jul 03 13:06:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:06:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:05 devstack sudo[103073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:06:05 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:05 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.814s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:06:09 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Flow 'volume_create_manager' (8cf12176-2ee1-42cc-90ea-179e4c33878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b96935b-04da-434d-ad30-40e253fb4fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b96935b-04da-434d-ad30-40e253fb4fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1619837357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efabddb-742d-49cf-9b58-cb2d36d0606c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2a70fd0c74c72b6f590ceb58f6f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:10Z,use_quota=True,user_id='9e95d0607bd24d1aa60b384c144fa3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328599a6-23ba-4b07-809e-58f3df71eddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328599a6-23ba-4b07-809e-58f3df71eddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f18d8ac-1376-4ed5-9b99-8af03d8859b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f18d8ac-1376-4ed5-9b99-8af03d8859b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7efabddb-742d-49cf-9b58-cb2d36d0606c', 'volume_name': 'volume-7efabddb-742d-49cf-9b58-cb2d36d0606c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f7e475-95b1-43b2-b1f6-08bf03144fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f7e475-95b1-43b2-b1f6-08bf03144fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1119daa-817f-47b8-8a09-8fbd150eac5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Volume 7efabddb-742d-49cf-9b58-cb2d36d0606c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7efabddb-742d-49cf-9b58-cb2d36d0606c', 'volume_size': 1}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1619837357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efabddb-742d-49cf-9b58-cb2d36d0606c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2a70fd0c74c72b6f590ceb58f6f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:10Z,use_quota=True,user_id='9e95d0607bd24d1aa60b384c144fa3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Creating volume 7efabddb-742d-49cf-9b58-cb2d36d0606c {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:06:10 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:06:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:10 devstack sudo[103080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c 1073741824
Jul 03 13:06:10 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:11 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c 1073741824" returned: 0 in 1.439s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:11 devstack sudo[103106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c
Jul 03 13:06:11 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:12 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c" returned: 0 in 1.074s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] <== create_volume: return (2615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:06:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.619s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1119daa-817f-47b8-8a09-8fbd150eac5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efabddb-742d-49cf-9b58-cb2d36d0606c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b28b3ae-60c4-453a-99bf-294e1c1b84e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:12 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Volume volume-7efabddb-742d-49cf-9b58-cb2d36d0606c (7efabddb-742d-49cf-9b58-cb2d36d0606c): created successfully
Jul 03 13:06:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b28b3ae-60c4-453a-99bf-294e1c1b84e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Flow 'volume_create_manager' (8cf12176-2ee1-42cc-90ea-179e4c33878c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c8ae2d8f-75c3-4cb7-9c5b-77c321b5affb tempest-SnapshotDependencyTests-1265147884 None] Created volume successfully.
Jul 03 13:06:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] Creating offline snapshot 039a5b0b-ca47-4ec6-b24f-8532a6f6a589 of volume 7efabddb-742d-49cf-9b58-cb2d36d0606c {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:06:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0253ee1e-e70b-4e53-867f-217776a31104]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:14 devstack sudo[103110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c
Jul 03 13:06:14 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:15 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c" returned: 0 in 1.117s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:15 devstack sudo[103115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589 1G
Jul 03 13:06:15 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:16 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589 1G" returned: 0 in 1.298s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7efabddb-742d-49cf-9b58-cb2d36d0606c -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:16 devstack sudo[103162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7efabddb-742d-49cf-9b58-cb2d36d0606c -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589
Jul 03 13:06:16 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:17 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7efabddb-742d-49cf-9b58-cb2d36d0606c -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589" returned: 0 in 0.763s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:17 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589 is being set with open permissions: ugo+rw
Jul 03 13:06:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:17 devstack sudo[103168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589
Jul 03 13:06:17 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:18 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589" returned: 0 in 0.944s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:18 devstack sudo[103216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.info
Jul 03 13:06:18 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:19 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.info" returned: 0 in 1.125s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:19 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.info is being set with open permissions: ugo+rw
Jul 03 13:06:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:19 devstack sudo[103240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.info
Jul 03 13:06:19 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:20 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.info" returned: 0 in 0.783s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.231s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8a7af1cc-b4bd-465a-a4ea-d261de5a4038 tempest-SnapshotDependencyTests-1265147884 None] Create snapshot completed successfully
Jul 03 13:06:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-009c8b49-420c-45a0-b2d0-71abd2f40f2b tempest-VolumesActionsTest-432203755 None] Acquiring lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1" by "attach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-009c8b49-420c-45a0-b2d0-71abd2f40f2b tempest-VolumesActionsTest-432203755 None] Lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1" acquired by "attach_volume" :: waited 0.055s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-009c8b49-420c-45a0-b2d0-71abd2f40f2b tempest-VolumesActionsTest-432203755 None] Attaching volume 74255de2-e998-47ed-859f-a4cbc91fcfe1 to instance c2e67732-c706-4d44-bc31-23b625bd50b8 at mountpoint /dev/vdb on host None.
Jul 03 13:06:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-009c8b49-420c-45a0-b2d0-71abd2f40f2b tempest-VolumesActionsTest-432203755 None] Attach volume completed successfully.
Jul 03 13:06:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-009c8b49-420c-45a0-b2d0-71abd2f40f2b tempest-VolumesActionsTest-432203755 None] Lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1" released by "attach_volume" :: held 0.165s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e967f617-0fa7-42a1-bf57-46f93c6d3790 tempest-VolumesActionsTest-432203755 None] Acquiring lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1-detach_volume" by "detach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e967f617-0fa7-42a1-bf57-46f93c6d3790 tempest-VolumesActionsTest-432203755 None] Lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e967f617-0fa7-42a1-bf57-46f93c6d3790 tempest-VolumesActionsTest-432203755 None] Detaching volume 74255de2-e998-47ed-859f-a4cbc91fcfe1 from instance c2e67732-c706-4d44-bc31-23b625bd50b8.
Jul 03 13:06:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e967f617-0fa7-42a1-bf57-46f93c6d3790 tempest-VolumesActionsTest-432203755 None] Detach volume completed successfully.
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e967f617-0fa7-42a1-bf57-46f93c6d3790 tempest-VolumesActionsTest-432203755 None] Lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Flow 'volume_create_manager' (5ac99c20-829a-4db0-9c55-5d3be4d6ea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717657a1-299e-4da5-b8cc-dcb2da4ab2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717657a1-299e-4da5-b8cc-dcb2da4ab2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e6f1bd-0800-482b-9fdb-ce865c7134f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2a70fd0c74c72b6f590ceb58f6f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=039a5b0b-ca47-4ec6-b24f-8532a6f6a589,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:22Z,use_quota=True,user_id='9e95d0607bd24d1aa60b384c144fa3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd9f3b6-6bc9-4a16-bfef-cc03a351daa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd9f3b6-6bc9-4a16-bfef-cc03a351daa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a0b1f9-397e-4b70-8541-a27042ddf7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a0b1f9-397e-4b70-8541-a27042ddf7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6e6f1bd-0800-482b-9fdb-ce865c7134f6', 'volume_name': 'volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6', 'volume_size': 1, 'snapshot_id': '039a5b0b-ca47-4ec6-b24f-8532a6f6a589'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff5a668-4c73-4ac8-ad0c-efd9208a64e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff5a668-4c73-4ac8-ad0c-efd9208a64e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36acc48a-2ac3-4665-bb15-ec237c4c4805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:22 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Volume e6e6f1bd-0800-482b-9fdb-ce865c7134f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6', 'volume_size': 1, 'snapshot_id': '039a5b0b-ca47-4ec6-b24f-8532a6f6a589'}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "cinder-quobyte-039a5b0b-ca47-4ec6-b24f-8532a6f6a589-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-039a5b0b-ca47-4ec6-b24f-8532a6f6a589-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Creating volume e6e6f1bd-0800-482b-9fdb-ce865c7134f6 from snapshot 039a5b0b-ca47-4ec6-b24f-8532a6f6a589 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "cinder-quobyte-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] snapshot: 039a5b0b-ca47-4ec6-b24f-8532a6f6a589, volume: e6e6f1bd-0800-482b-9fdb-ce865c7134f6,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a27912-6745-43e9-bb8b-140f2843c47b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:22 devstack sudo[103244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589
Jul 03 13:06:22 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:23 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589" returned: 0 in 0.897s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7efabddb-742d-49cf-9b58-cb2d36d0606c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:06:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:06:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:06:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aa8ec1-5321-4b3f-942e-2f3211706a8b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:23 devstack sudo[103249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c
Jul 03 13:06:23 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:24 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c" returned: 0 in 1.278s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:24 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 13:06:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:24 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6
Jul 03 13:06:24 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:30 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" returned: 0 in 5.947s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:30 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[068a0a72-ef21-4e42-9a1d-d32912401217]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:30 devstack sudo[103314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c
Jul 03 13:06:30 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:32 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c" returned: 0 in 1.319s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:32 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:06:32 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Converted 1024.00 MB image at 172.13 MB/s
Jul 03 13:06:32 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6 is being set with open permissions: ugo+rw
Jul 03 13:06:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:32 devstack sudo[103323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6
Jul 03 13:06:32 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:32 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=5 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:06:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Acquiring lock "cinder-21456c46-6f64-414d-9309-763460e25d49-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Lock "cinder-21456c46-6f64-414d-9309-763460e25d49-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:32 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=18,cinder:UPDATE=10,cinder:DELETE=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:06:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Acquiring lock "cinder-quobyte-21456c46-6f64-414d-9309-763460e25d49" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Lock "cinder-quobyte-21456c46-6f64-414d-9309-763460e25d49" acquired by "delete_volume" :: waited 0.043s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f66587-847a-49f8-8a3d-50a00fe6cd72]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:32 devstack sudo[103325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49
Jul 03 13:06:32 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:33 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" returned: 0 in 0.881s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" released by "_copy_volume_from_snapshot" :: held 10.476s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-039a5b0b-ca47-4ec6-b24f-8532a6f6a589-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" released by "_create_volume_from_snapshot" :: held 10.515s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.533s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36acc48a-2ac3-4665-bb15-ec237c4c4805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6', 'volume_size': 1, 'snapshot_id': '039a5b0b-ca47-4ec6-b24f-8532a6f6a589'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0a6dde-62af-4d1d-83f0-e423cc3b142a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:33 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Volume volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6 (e6e6f1bd-0800-482b-9fdb-ce865c7134f6): created successfully
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0a6dde-62af-4d1d-83f0-e423cc3b142a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Flow 'volume_create_manager' (5ac99c20-829a-4db0-9c55-5d3be4d6ea72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-65765820-81d4-4c6d-aa6a-abbd0b20ca9a tempest-SnapshotDependencyTests-1265147884 None] Created volume successfully.
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "cinder-039a5b0b-ca47-4ec6-b24f-8532a6f6a589-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-039a5b0b-ca47-4ec6-b24f-8532a6f6a589-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "cinder-quobyte-7efabddb-742d-49cf-9b58-cb2d36d0606c" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-7efabddb-742d-49cf-9b58-cb2d36d0606c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "cinder-quobyte-039a5b0b-ca47-4ec6-b24f-8532a6f6a589" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-039a5b0b-ca47-4ec6-b24f-8532a6f6a589" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:33 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Deleting offline snapshot 039a5b0b-ca47-4ec6-b24f-8532a6f6a589 of volume 7efabddb-742d-49cf-9b58-cb2d36d0606c {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] snapshot_file for this snap is: volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49" returned: 0 in 0.989s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f9253-b8ed-4a7a-a605-24750b8e355f]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:33 devstack sudo[103332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49
Jul 03 13:06:33 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:33 devstack sudo[103333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589
Jul 03 13:06:33 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:34 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-21456c46-6f64-414d-9309-763460e25d49" returned: 0 in 0.869s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Lock "cinder-quobyte-21456c46-6f64-414d-9309-763460e25d49" released by "delete_volume" :: held 1.922s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:34 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589" returned: 0 in 0.909s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7efabddb-742d-49cf-9b58-cb2d36d0606c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a326d15-9f5a-47d4-87f3-28e0a9901b04]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Created reservations ['8a59d868-8490-4fb1-b8bc-c8fa5722d8c7', '33013ee2-67d1-481a-9fca-f7437db15b58', 'f8488856-1961-4bb0-84b9-75eecf00a3cf', 'f6bca353-6716-486d-94d4-3c67f32a4661'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:34 devstack sudo[103341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:06:34 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:34 devstack sudo[103340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c
Jul 03 13:06:34 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:35 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.959s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:35 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:06:35 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c" returned: 0 in 1.080s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Deleted volume successfully.
Jul 03 13:06:35 devstack sudo[103348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589
Jul 03 13:06:35 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e2b18355-26fd-4cfb-8b5e-71f291ae1fc7 tempest-VolumesNegativeTest-588956484 None] Lock "cinder-21456c46-6f64-414d-9309-763460e25d49-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:36 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589" returned: 0 in 0.956s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:36 devstack sudo[103353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589
Jul 03 13:06:36 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:37 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c.039a5b0b-ca47-4ec6-b24f-8532a6f6a589" returned: 0 in 0.886s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-039a5b0b-ca47-4ec6-b24f-8532a6f6a589" released by "_delete_snapshot" :: held 4.043s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-7efabddb-742d-49cf-9b58-cb2d36d0606c" released by "delete_snapshot" :: held 4.081s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Created reservations ['5cf09456-7d2e-40bb-b3a5-1c2eef41c63b', 'f842353b-d6b1-482b-bf1b-137545ceecdf', '033929eb-339c-4c14-9e52-5114349f7e0c', '3ce0afeb-350a-4c02-853c-c8ccfef31316'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:06:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Delete snapshot completed successfully.
Jul 03 13:06:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c5be4296-8ac4-430e-95f7-6d1e7388ad73 tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-039a5b0b-ca47-4ec6-b24f-8532a6f6a589-delete_snapshot" released by "delete_snapshot" :: held 4.374s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "cinder-7efabddb-742d-49cf-9b58-cb2d36d0606c-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-7efabddb-742d-49cf-9b58-cb2d36d0606c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "cinder-quobyte-7efabddb-742d-49cf-9b58-cb2d36d0606c" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-7efabddb-742d-49cf-9b58-cb2d36d0606c" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c727108-af16-4fa0-87a0-c2c8ad924161]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:39 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c
Jul 03 13:06:39 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:40 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c" returned: 0 in 0.994s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:40 devstack sudo[103379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c
Jul 03 13:06:40 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:40 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7efabddb-742d-49cf-9b58-cb2d36d0606c" returned: 0 in 0.728s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-7efabddb-742d-49cf-9b58-cb2d36d0606c" released by "delete_volume" :: held 1.842s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Created reservations ['30ffc2d0-3ce5-4353-8591-fe337acffa36', '6ad5ae94-c74a-4be1-8503-66097180ca33', '7208818e-fe77-42c7-bd3d-381a0efe9566', '5c9972e7-e54c-4831-956f-4defc064a1a8'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:41 devstack sudo[103383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:06:41 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "cinder-e6e6f1bd-0800-482b-9fdb-ce865c7134f6-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-e6e6f1bd-0800-482b-9fdb-ce865c7134f6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "cinder-quobyte-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad1c14b-83de-4ebc-a645-05fd6da47372]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:41 devstack sudo[103385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6
Jul 03 13:06:41 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:42 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.888s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:42 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:06:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Deleted volume successfully.
Jul 03 13:06:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ee1ab644-07a9-4c65-84da-51634fbe5dc8 tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-7efabddb-742d-49cf-9b58-cb2d36d0606c-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:42 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" returned: 0 in 1.011s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:42 devstack sudo[103391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6
Jul 03 13:06:42 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:43 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" returned: 0 in 0.738s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-quobyte-e6e6f1bd-0800-482b-9fdb-ce865c7134f6" released by "delete_volume" :: held 1.813s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:43 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Created reservations ['88258c79-6d2a-4716-82d0-e7b184938ee9', '74acde58-a4cb-4579-b839-73ed2a0fafc1', 'da45c50e-bfd7-4281-b3bc-c1564f950173', 'de69fb67-4e14-4041-b954-9cdd54d595c2'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:06:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:43 devstack sudo[103398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:06:43 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:44 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.891s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:44 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:06:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Deleted volume successfully.
Jul 03 13:06:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f4346736-ad67-4add-b906-4550f844f0eb tempest-SnapshotDependencyTests-1265147884 None] Lock "cinder-e6e6f1bd-0800-482b-9fdb-ce865c7134f6-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-99e58195-091f-4e00-9678-b35076f9d17c tempest-VolumesActionsTest-432203755 None] Acquiring lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1" by "attach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-99e58195-091f-4e00-9678-b35076f9d17c tempest-VolumesActionsTest-432203755 None] Lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1" acquired by "attach_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-99e58195-091f-4e00-9678-b35076f9d17c tempest-VolumesActionsTest-432203755 None] Attaching volume 74255de2-e998-47ed-859f-a4cbc91fcfe1 to instance d92e0805-b357-4df2-9db7-4ca3aaa0979a at mountpoint /dev/vdb on host None.
Jul 03 13:06:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-99e58195-091f-4e00-9678-b35076f9d17c tempest-VolumesActionsTest-432203755 None] Attach volume completed successfully.
Jul 03 13:06:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-99e58195-091f-4e00-9678-b35076f9d17c tempest-VolumesActionsTest-432203755 None] Lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1" released by "attach_volume" :: held 0.193s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c4da641b-65c6-4e84-8d9e-47481c82df59 tempest-VolumesActionsTest-432203755 None] Acquiring lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1-detach_volume" by "detach_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c4da641b-65c6-4e84-8d9e-47481c82df59 tempest-VolumesActionsTest-432203755 None] Lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c4da641b-65c6-4e84-8d9e-47481c82df59 tempest-VolumesActionsTest-432203755 None] Detaching volume 74255de2-e998-47ed-859f-a4cbc91fcfe1 from instance d92e0805-b357-4df2-9db7-4ca3aaa0979a.
Jul 03 13:06:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c4da641b-65c6-4e84-8d9e-47481c82df59 tempest-VolumesActionsTest-432203755 None] Detach volume completed successfully.
Jul 03 13:06:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c4da641b-65c6-4e84-8d9e-47481c82df59 tempest-VolumesActionsTest-432203755 None] Lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1-detach_volume" released by "detach_volume" :: held 0.127s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:03 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=23,cinder:UPDATE=34,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:07:03 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=35,cinder:DELETE=2,cinder:SELECT=33,cinder:INSERT=8 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:05 devstack sudo[103571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:07:05 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e5947d-cf51-463a-a129-fba450a85314]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:05 devstack sudo[103573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1
Jul 03 13:07:05 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:05 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.753s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:07:06 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1" returned: 0 in 0.853s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:06 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f0b20d-28b7-48b2-8d14-45537e6ca8e6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:06 devstack sudo[103579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1
Jul 03 13:07:06 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:06 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1" returned: 0 in 0.878s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.65b65189-f3b4-4880-b932-d51ef60217bcwv1rf5yh.img {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:06 devstack sudo[103584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.65b65189-f3b4-4880-b932-d51ef60217bcwv1rf5yh.img
Jul 03 13:07:06 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:12 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.65b65189-f3b4-4880-b932-d51ef60217bcwv1rf5yh.img" returned: 0 in 5.166s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3139f0ad-4d20-493f-990d-467213818f4a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:12 devstack sudo[103597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1
Jul 03 13:07:12 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:13 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1" returned: 0 in 1.009s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:13 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1, size 1024.00 MB, duration 5.17 sec, destination /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.65b65189-f3b4-4880-b932-d51ef60217bcwv1rf5yh.img {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:07:13 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] Converted 1024.00 MB image at 198.15 MB/s
Jul 03 13:07:13 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] 65b65189-f3b4-4880-b932-d51ef60217bc was raw, no need to convert to raw {{(pid=86763) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Flow 'volume_create_manager' (6d3d6713-5bfe-4d08-aa5d-6d1a64cd2c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6379181c-7e11-4c70-b7db-f4e864ebcdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6379181c-7e11-4c70-b7db-f4e864ebcdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-273033917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7755a283-d858-4916-92b6-80f84f3f50cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edafe31810646a8975dc6d42ff5b7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:14Z,use_quota=True,user_id='281928e19ad2487099279259ab2796e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9c2d099-412f-422b-8190-79a042439d5a),volume_type_id=d9c2d099-412f-422b-8190-79a042439d5a)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518dcc7a-2935-4e47-940c-2a6309199337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518dcc7a-2935-4e47-940c-2a6309199337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2724c1f-36f5-4c60-98f4-a2d3bd327fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2724c1f-36f5-4c60-98f4-a2d3bd327fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7755a283-d858-4916-92b6-80f84f3f50cd', 'volume_name': 'volume-7755a283-d858-4916-92b6-80f84f3f50cd', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084365f6-7825-4ee8-8881-6778f5f50fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084365f6-7825-4ee8-8881-6778f5f50fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8de9ea8-bd2f-4e2c-9bd7-547295b0495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:14 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Volume 7755a283-d858-4916-92b6-80f84f3f50cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7755a283-d858-4916-92b6-80f84f3f50cd', 'volume_size': 1}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Flow 'volume_create_manager' (ad084446-be70-4685-b934-10b1a37f0152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428ddf79-e0a1-482a-82f8-0f630f709fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428ddf79-e0a1-482a-82f8-0f630f709fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1335103050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f0e083-729a-42dc-89a0-ac535b9b007e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edafe31810646a8975dc6d42ff5b7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:15Z,use_quota=True,user_id='281928e19ad2487099279259ab2796e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b84361ab-ca49-4d0b-b482-ab9f7e8dbd8e),volume_type_id=b84361ab-ca49-4d0b-b482-ab9f7e8dbd8e)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987a708e-7e51-4097-90c8-a68d3f90868c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987a708e-7e51-4097-90c8-a68d3f90868c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e5b6f0-a8bd-4bff-a5fb-a20c795fe61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e5b6f0-a8bd-4bff-a5fb-a20c795fe61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f0e083-729a-42dc-89a0-ac535b9b007e', 'volume_name': 'volume-11f0e083-729a-42dc-89a0-ac535b9b007e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a6cc83-7bdf-45e1-9032-c528b19e8fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a6cc83-7bdf-45e1-9032-c528b19e8fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efc6022-8c96-4b17-88e4-b19662b74e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:14 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Volume 11f0e083-729a-42dc-89a0-ac535b9b007e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f0e083-729a-42dc-89a0-ac535b9b007e', 'volume_size': 1}
Jul 03 13:07:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Flow 'volume_create_manager' (8acbfb1b-4ce9-4ca1-853a-8bc61b5148e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050082d4-49d0-4af0-b869-d837780f759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050082d4-49d0-4af0-b869-d837780f759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1256553944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6701172b-2fb3-40b5-8a63-2f180f554a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edafe31810646a8975dc6d42ff5b7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:16Z,use_quota=True,user_id='281928e19ad2487099279259ab2796e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc4acd9c-5db6-4f32-8501-c6029e107801),volume_type_id=dc4acd9c-5db6-4f32-8501-c6029e107801)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42963d82-a89c-41a0-945d-3d3eb29bdd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42963d82-a89c-41a0-945d-3d3eb29bdd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e49a360-56ff-476f-80f4-36725998cde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e49a360-56ff-476f-80f4-36725998cde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6701172b-2fb3-40b5-8a63-2f180f554a9d', 'volume_name': 'volume-6701172b-2fb3-40b5-8a63-2f180f554a9d', 'volume_size': 1, 'image_id': '89e2c6b0-b294-4660-80af-efd18ad302df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89e2c6b0-b294-4660-80af-efd18ad302df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--970671628', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6edafe31810646a8975dc6d42ff5b7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89e2c6b0-b294-4660-80af-efd18ad302df', 'created_at': datetime.datetime(2026, 7, 3, 11, 7, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 7, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89e2c6b0-b294-4660-80af-efd18ad302df/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b6502bd0>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0851875-56ac-4577-93c4-2660c0011d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0851875-56ac-4577-93c4-2660c0011d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7dff1d-089d-47cc-b875-68e941b6a100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:15 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Volume 6701172b-2fb3-40b5-8a63-2f180f554a9d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6701172b-2fb3-40b5-8a63-2f180f554a9d', 'volume_size': 1, 'image_id': '89e2c6b0-b294-4660-80af-efd18ad302df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89e2c6b0-b294-4660-80af-efd18ad302df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--970671628', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6edafe31810646a8975dc6d42ff5b7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89e2c6b0-b294-4660-80af-efd18ad302df', 'created_at': datetime.datetime(2026, 7, 3, 11, 7, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 7, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89e2c6b0-b294-4660-80af-efd18ad302df/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b6502bd0>}
Jul 03 13:07:15 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Trying to clone 6701172b-2fb3-40b5-8a63-2f180f554a9d from image 89e2c6b0-b294-4660-80af-efd18ad302df at location (None, [{'url': 'file:///opt/stack/data/glance/images/89e2c6b0-b294-4660-80af-efd18ad302df', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jul 03 13:07:19 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD, size 20.69 MB, duration 3.92 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jul 03 13:07:19 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Image download 20.69 MB at 5.27 MB/s
Jul 03 13:07:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaa9035-680c-426b-9f13-c72cee5024a1]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:20 devstack sudo[103602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD
Jul 03 13:07:20 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:20 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:20 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Temporary image 89e2c6b0-b294-4660-80af-efd18ad302df is fetched for user 281928e19ad2487099279259ab2796e6. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jul 03 13:07:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6a6bbd-16bd-4386-957f-bdfe5b0fde14]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:21 devstack sudo[103608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD
Jul 03 13:07:21 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:21 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD" returned: 0 in 0.816s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:30 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=6 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:07:30 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.042s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] Uploaded volume to glance image-id: 65b65189-f3b4-4880-b932-d51ef60217bc. {{(pid=86763) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.713s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-273033917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7755a283-d858-4916-92b6-80f84f3f50cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edafe31810646a8975dc6d42ff5b7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:14Z,use_quota=True,user_id='281928e19ad2487099279259ab2796e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9c2d099-412f-422b-8190-79a042439d5a),volume_type_id=d9c2d099-412f-422b-8190-79a042439d5a)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Creating volume 7755a283-d858-4916-92b6-80f84f3f50cd {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:07:33 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:07:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:33 devstack sudo[103614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd 1073741824
Jul 03 13:07:33 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e2d29fdd-a298-4023-b7cc-cc3ddc952f9e tempest-VolumesActionsTest-432203755 None] Copy volume to image completed successfully.
Jul 03 13:07:34 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd 1073741824" returned: 0 in 0.960s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:34 devstack sudo[103619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd
Jul 03 13:07:34 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:35 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd" returned: 0 in 0.785s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.057s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1335103050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f0e083-729a-42dc-89a0-ac535b9b007e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edafe31810646a8975dc6d42ff5b7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:15Z,use_quota=True,user_id='281928e19ad2487099279259ab2796e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b84361ab-ca49-4d0b-b482-ab9f7e8dbd8e),volume_type_id=b84361ab-ca49-4d0b-b482-ab9f7e8dbd8e)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Creating volume 11f0e083-729a-42dc-89a0-ac535b9b007e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:07:35 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8de9ea8-bd2f-4e2c-9bd7-547295b0495e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7755a283-d858-4916-92b6-80f84f3f50cd', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:35 devstack sudo[103622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e 1073741824
Jul 03 13:07:35 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1cba69-7790-481e-9aba-785c3cb58a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Volume volume-7755a283-d858-4916-92b6-80f84f3f50cd (7755a283-d858-4916-92b6-80f84f3f50cd): created successfully
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1cba69-7790-481e-9aba-785c3cb58a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Flow 'volume_create_manager' (6d3d6713-5bfe-4d08-aa5d-6d1a64cd2c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d3ce220f-ac51-4f28-b8ad-983d2b819dca tempest-TestInstancesWithCinderVolumes-506737802 None] Created volume successfully.
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:35 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e 1073741824" returned: 0 in 0.848s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:35 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e
Jul 03 13:07:35 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:36 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e" returned: 0 in 0.726s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.942s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1256553944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6701172b-2fb3-40b5-8a63-2f180f554a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edafe31810646a8975dc6d42ff5b7d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:16Z,use_quota=True,user_id='281928e19ad2487099279259ab2796e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc4acd9c-5db6-4f32-8501-c6029e107801),volume_type_id=dc4acd9c-5db6-4f32-8501-c6029e107801)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Creating volume 6701172b-2fb3-40b5-8a63-2f180f554a9d {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:07:36 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efc6022-8c96-4b17-88e4-b19662b74e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f0e083-729a-42dc-89a0-ac535b9b007e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:36 devstack sudo[103631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d 1073741824
Jul 03 13:07:36 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73ab629-b98c-436d-9fc8-4cea139b331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:36 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Volume volume-11f0e083-729a-42dc-89a0-ac535b9b007e (11f0e083-729a-42dc-89a0-ac535b9b007e): created successfully
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73ab629-b98c-436d-9fc8-4cea139b331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Flow 'volume_create_manager' (ad084446-be70-4685-b934-10b1a37f0152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-aa37e6b5-53d2-4f08-96ba-3dfbaa097bfd tempest-TestInstancesWithCinderVolumes-506737802 None] Created volume successfully.
Jul 03 13:07:37 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d 1073741824" returned: 0 in 0.874s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:37 devstack sudo[103637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d
Jul 03 13:07:37 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:38 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d" returned: 0 in 0.920s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:07:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.248s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b08b65-c514-41e8-bc15-91c094106962]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:38 devstack sudo[103640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1
Jul 03 13:07:38 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:39 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Attempting download of 89e2c6b0-b294-4660-80af-efd18ad302df ((None, [{'url': 'file:///opt/stack/data/glance/images/89e2c6b0-b294-4660-80af-efd18ad302df', 'metadata': {}}])) to volume 6701172b-2fb3-40b5-8a63-2f180f554a9d. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jul 03 13:07:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f12df4-cb8c-4886-974d-1813283e4f9e]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89e2c6b0-b294-4660-80af-efd18ad302df_j0jmv479 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:39 devstack sudo[103642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89e2c6b0-b294-4660-80af-efd18ad302df_j0jmv479
Jul 03 13:07:39 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:39 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1" returned: 0 in 1.217s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e175b6a-6ea4-45ca-aa92-9daedcd3a8fb]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:39 devstack sudo[103647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1
Jul 03 13:07:39 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:40 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89e2c6b0-b294-4660-80af-efd18ad302df_j0jmv479" returned: 0 in 1.073s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89e2c6b0-b294-4660-80af-efd18ad302df_j0jmv479 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:40 devstack sudo[103651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89e2c6b0-b294-4660-80af-efd18ad302df_j0jmv479
Jul 03 13:07:40 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:40 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1" returned: 0 in 0.913s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:40 devstack sudo[103657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img
Jul 03 13:07:40 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:41 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89e2c6b0-b294-4660-80af-efd18ad302df_j0jmv479" returned: 1 in 0.896s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89e2c6b0-b294-4660-80af-efd18ad302df_j0jmv479' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:07:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a51ed-7002-44a2-8b50-ed9f16dd4eab]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:41 devstack sudo[103661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD
Jul 03 13:07:41 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:42 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD" returned: 0 in 1.808s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:42 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] 89e2c6b0-b294-4660-80af-efd18ad302df was qcow2, converting to raw {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jul 03 13:07:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:42 devstack sudo[103677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d
Jul 03 13:07:42 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:45 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img" returned: 0 in 4.822s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:45 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98778d-1e76-44d9-8c92-ee35af6794cf]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:45 devstack sudo[103685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1
Jul 03 13:07:45 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:46 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d" returned: 0 in 3.642s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:46 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89e2c6b0-b294-4660-80af-efd18ad302df_hzzyfmwhdevstack@QuobyteHD, size 112.00 MB, duration 3.64 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:07:46 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Converted 112.00 MB image at 30.74 MB/s
Jul 03 13:07:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:46 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:46 devstack sudo[103690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d 1G
Jul 03 13:07:46 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1" returned: 0 in 1.019s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:46 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:07:46 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Converted 1024.00 MB image at 212.29 MB/s
Jul 03 13:07:46 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] 32a95f5b-6882-41ef-9774-130af34016ab was raw, converting to qcow2 {{(pid=86763) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Jul 03 13:07:46 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f68d5d-cd60-44e6-80c7-792dd3c9695b]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:46 devstack sudo[103692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img
Jul 03 13:07:46 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:47 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d 1G" returned: 0 in 0.807s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:47 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b20a25-49c8-489b-989d-12af73b33667]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:47 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img" returned: 0 in 0.873s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:47 devstack sudo[103701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d
Jul 03 13:07:47 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:47 devstack sudo[103702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img
Jul 03 13:07:47 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:48 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d" returned: 0 in 0.967s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:48 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img" returned: 1 in 0.956s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:07:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img /opt/stack/data/cinder/conversion/vol_upload_p94wojs0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:48 devstack sudo[103711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img /opt/stack/data/cinder/conversion/vol_upload_p94wojs0
Jul 03 13:07:48 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:48 devstack sudo[103710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d
Jul 03 13:07:48 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:48 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:07:49 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img /opt/stack/data/cinder/conversion/vol_upload_p94wojs0" returned: 0 in 0.760s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Image conversion details: src /opt/stack/data/cinder/conversion/74255de2-e998-47ed-859f-a4cbc91fcfe1.temp_image.32a95f5b-6882-41ef-9774-130af34016abrs1htbz4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_p94wojs0 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:07:49 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a88116d-fa46-4225-8d48-13d87f84d66c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p94wojs0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:49 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d" returned: 1 in 0.875s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Downloaded image 89e2c6b0-b294-4660-80af-efd18ad302df ((None, [{'url': 'file:///opt/stack/data/glance/images/89e2c6b0-b294-4660-80af-efd18ad302df', 'metadata': {}}])) to volume 6701172b-2fb3-40b5-8a63-2f180f554a9d successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Temporary image 89e2c6b0-b294-4660-80af-efd18ad302df for user 281928e19ad2487099279259ab2796e6 is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Marking volume 6701172b-2fb3-40b5-8a63-2f180f554a9d as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Copying metadata from image 89e2c6b0-b294-4660-80af-efd18ad302df to 6701172b-2fb3-40b5-8a63-2f180f554a9d. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Creating volume glance metadata for volume 6701172b-2fb3-40b5-8a63-2f180f554a9d backed by image 89e2c6b0-b294-4660-80af-efd18ad302df with: {'image_id': '89e2c6b0-b294-4660-80af-efd18ad302df', 'image_name': 'tempest-scenario-img--970671628', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:07:49 devstack sudo[103721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p94wojs0
Jul 03 13:07:49 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7dff1d-089d-47cc-b875-68e941b6a100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6701172b-2fb3-40b5-8a63-2f180f554a9d', 'volume_size': 1, 'image_id': '89e2c6b0-b294-4660-80af-efd18ad302df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89e2c6b0-b294-4660-80af-efd18ad302df', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--970671628', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6edafe31810646a8975dc6d42ff5b7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89e2c6b0-b294-4660-80af-efd18ad302df', 'created_at': datetime.datetime(2026, 7, 3, 11, 7, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 7, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89e2c6b0-b294-4660-80af-efd18ad302df/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b6502bd0>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1fb819-0f56-4af8-b9d4-8836eddfe101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:49 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Volume volume-6701172b-2fb3-40b5-8a63-2f180f554a9d (6701172b-2fb3-40b5-8a63-2f180f554a9d): created successfully
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1fb819-0f56-4af8-b9d4-8836eddfe101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Flow 'volume_create_manager' (8acbfb1b-4ce9-4ca1-853a-8bc61b5148e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:49 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f91c7041-9527-4c8b-8e12-e325d144f3bd tempest-TestInstancesWithCinderVolumes-506737802 None] Created volume successfully.
Jul 03 13:07:50 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p94wojs0" returned: 0 in 0.877s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.045s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Uploaded volume to glance image-id: 32a95f5b-6882-41ef-9774-130af34016ab. {{(pid=86763) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 03 13:07:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-685933f0-5e65-469b-8c66-7347869adc64 tempest-VolumesActionsTest-432203755 None] Copy volume to image completed successfully.
Jul 03 13:07:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Acquiring lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Acquiring lock "cinder-quobyte-74255de2-e998-47ed-859f-a4cbc91fcfe1" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Lock "cinder-quobyte-74255de2-e998-47ed-859f-a4cbc91fcfe1" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[153050bd-296e-4535-8da7-a6c110775a94]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:52 devstack sudo[103732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1
Jul 03 13:07:52 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:53 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1" returned: 0 in 0.757s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:53 devstack sudo[103737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1
Jul 03 13:07:53 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:54 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-74255de2-e998-47ed-859f-a4cbc91fcfe1" returned: 0 in 0.707s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Lock "cinder-quobyte-74255de2-e998-47ed-859f-a4cbc91fcfe1" released by "delete_volume" :: held 1.505s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:54 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Created reservations ['2a15b916-23e5-4fbe-b655-6a53b90ada6e', '83f7e059-394d-40f5-8a6c-38cb087c5b68', 'b46f80e5-3ce2-48ba-8224-e5df9889ee1b', '37a7e4bc-1135-4c81-a100-38ad5fa5fefc'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:07:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:54 devstack sudo[103740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:07:54 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:55 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.787s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:55 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:07:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Deleted volume successfully.
Jul 03 13:07:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7785fe2f-499a-443d-b67e-1d8acffe18d8 tempest-VolumesActionsTest-432203755 None] Lock "cinder-74255de2-e998-47ed-859f-a4cbc91fcfe1-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-6b7212b2-6349-43a4-a935-3f8c2947ab3b req-9cd3b08a-dc8f-46b1-9425-aa534fac4bb3 tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-6b7212b2-6349-43a4-a935-3f8c2947ab3b req-9cd3b08a-dc8f-46b1-9425-aa534fac4bb3 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[136bd839-9773-4856-a917-7e5c8973ef7a]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6b7212b2-6349-43a4-a935-3f8c2947ab3b req-9cd3b08a-dc8f-46b1-9425-aa534fac4bb3 tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:57 devstack sudo[103752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d
Jul 03 13:07:57 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:58 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6b7212b2-6349-43a4-a935-3f8c2947ab3b req-9cd3b08a-dc8f-46b1-9425-aa534fac4bb3 tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d" returned: 0 in 1.079s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6b7212b2-6349-43a4-a935-3f8c2947ab3b req-9cd3b08a-dc8f-46b1-9425-aa534fac4bb3 tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:58 devstack sudo[103758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d
Jul 03 13:07:58 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:59 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6b7212b2-6349-43a4-a935-3f8c2947ab3b req-9cd3b08a-dc8f-46b1-9425-aa534fac4bb3 tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d" returned: 1 in 0.914s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-6b7212b2-6349-43a4-a935-3f8c2947ab3b req-9cd3b08a-dc8f-46b1-9425-aa534fac4bb3 tempest-TestInstancesWithCinderVolumes-506737802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:07:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-6b7212b2-6349-43a4-a935-3f8c2947ab3b req-9cd3b08a-dc8f-46b1-9425-aa534fac4bb3 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.049s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-6b7212b2-6349-43a4-a935-3f8c2947ab3b req-9cd3b08a-dc8f-46b1-9425-aa534fac4bb3 tempest-TestInstancesWithCinderVolumes-506737802 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-6701172b-2fb3-40b5-8a63-2f180f554a9d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1387dce-f5c8-4b73-9123-7db6c7282ff5', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:07:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-6b7212b2-6349-43a4-a935-3f8c2947ab3b req-9cd3b08a-dc8f-46b1-9425-aa534fac4bb3 tempest-TestInstancesWithCinderVolumes-506737802 None] attachment_update completed successfully.
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Flow 'volume_create_manager' (e972bd60-2863-440e-b6f4-93e25ac17267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b69cfd9-66d3-48f6-8bb9-bd369bea7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b69cfd9-66d3-48f6-8bb9-bd369bea7a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-984386243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd99fb75-98ee-4e1d-93ee-b22c4115d7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5045955641314b2b88a864b0c2c7c8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:04Z,use_quota=True,user_id='b1b5b5099a5d47c78537a9025268a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6988a16-2892-4dff-b6c7-ebfd31c8059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6988a16-2892-4dff-b6c7-ebfd31c8059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01ea6c6-a965-4aae-8daa-ca15d023cf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01ea6c6-a965-4aae-8daa-ca15d023cf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd99fb75-98ee-4e1d-93ee-b22c4115d7b5', 'volume_name': 'volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8824ef6d-0922-469c-adcb-00efc9dd4b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8824ef6d-0922-469c-adcb-00efc9dd4b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f846ec-4083-4247-b0b5-ca68701a646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Volume bd99fb75-98ee-4e1d-93ee-b22c4115d7b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5', 'volume_size': 1}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-984386243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd99fb75-98ee-4e1d-93ee-b22c4115d7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5045955641314b2b88a864b0c2c7c8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:04Z,use_quota=True,user_id='b1b5b5099a5d47c78537a9025268a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Creating volume bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:08:03 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:08:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:03 devstack sudo[103874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 1073741824
Jul 03 13:08:03 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:08:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:05 devstack sudo[104257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:08:05 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:05 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 1073741824" returned: 0 in 1.597s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:05 devstack sudo[104262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5
Jul 03 13:08:05 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:06 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.969s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:08:06 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5" returned: 0 in 0.843s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] <== create_volume: return (2501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:08:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.504s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f846ec-4083-4247-b0b5-ca68701a646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7252001a-2032-45a1-aa46-f48654181407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:06 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Volume volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 (bd99fb75-98ee-4e1d-93ee-b22c4115d7b5): created successfully
Jul 03 13:08:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7252001a-2032-45a1-aa46-f48654181407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Flow 'volume_create_manager' (e972bd60-2863-440e-b6f4-93e25ac17267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4e5d6dee-cf0f-445e-a7d7-824f24e06105 tempest-VolumesCloneTest-1440546339 None] Created volume successfully.
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Flow 'volume_create_manager' (fd34bd17-cf06-4d4e-9e3a-dcca69b6edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b5e60a-d279-4409-88b9-01c7e00b8a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b5e60a-d279-4409-88b9-01c7e00b8a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-78823340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0662b957-fe4e-462f-9bd9-19905e73f24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5045955641314b2b88a864b0c2c7c8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=bd99fb75-98ee-4e1d-93ee-b22c4115d7b5,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:07Z,use_quota=True,user_id='b1b5b5099a5d47c78537a9025268a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c260c0-f004-4a8d-8e93-e5e403147e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c260c0-f004-4a8d-8e93-e5e403147e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57bd5a41-d53d-4209-a176-34d313238a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57bd5a41-d53d-4209-a176-34d313238a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0662b957-fe4e-462f-9bd9-19905e73f24d', 'volume_name': 'volume-0662b957-fe4e-462f-9bd9-19905e73f24d', 'volume_size': 2, 'source_volid': 'bd99fb75-98ee-4e1d-93ee-b22c4115d7b5', 'source_volstatus': 'available'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dc7000-2693-44d2-86aa-f981015248a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dc7000-2693-44d2-86aa-f981015248a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b62777-aaab-4342-b66d-280eff131c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Volume 0662b957-fe4e-462f-9bd9-19905e73f24d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0662b957-fe4e-462f-9bd9-19905e73f24d', 'volume_size': 2, 'source_volid': 'bd99fb75-98ee-4e1d-93ee-b22c4115d7b5', 'source_volstatus': 'available'}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:07 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Cloning volume bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 to volume 0662b957-fe4e-462f-9bd9-19905e73f24d
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Creating offline snapshot fb4dbf38-7585-4361-b03a-94d638fd843c of volume bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae4fedc-7aac-4959-9d6d-b132a6342fe2]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:08 devstack sudo[104269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5
Jul 03 13:08:08 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:08 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5" returned: 0 in 1.071s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:08 devstack sudo[104276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c 1G
Jul 03 13:08:08 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:09 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c 1G" returned: 0 in 1.045s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:10 devstack sudo[104282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c
Jul 03 13:08:10 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:10 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c" returned: 0 in 0.928s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:10 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c is being set with open permissions: ugo+rw
Jul 03 13:08:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:10 devstack sudo[104289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c
Jul 03 13:08:10 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:11 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c" returned: 0 in 0.991s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:12 devstack sudo[104293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.info
Jul 03 13:08:12 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:12 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.info" returned: 0 in 0.766s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:12 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.info is being set with open permissions: ugo+rw
Jul 03 13:08:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:12 devstack sudo[104296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.info
Jul 03 13:08:12 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:13 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.info" returned: 0 in 0.780s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "cinder-quobyte-0662b957-fe4e-462f-9bd9-19905e73f24d" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-quobyte-0662b957-fe4e-462f-9bd9-19905e73f24d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] snapshot: fb4dbf38-7585-4361-b03a-94d638fd843c, volume: 0662b957-fe4e-462f-9bd9-19905e73f24d,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:08:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8108e05-bee0-4507-bb42-5b334b53b238]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:13 devstack sudo[104299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c
Jul 03 13:08:13 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:14 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c" returned: 0 in 0.870s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:08:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:08:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:08:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c05b6b2-cf28-4980-b391-bb3e426cf688]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:14 devstack sudo[104304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5
Jul 03 13:08:14 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:15 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5" returned: 0 in 0.852s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:15 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 13:08:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:15 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d
Jul 03 13:08:15 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:21 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=26,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=7 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:08:21 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:08:22 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d" returned: 0 in 6.831s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[01be6902-ab81-439a-a9ca-3f48dfea533b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:22 devstack sudo[104427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5
Jul 03 13:08:22 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:23 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5" returned: 0 in 1.166s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:23 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:08:23 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Converted 1024.00 MB image at 149.88 MB/s
Jul 03 13:08:23 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d is being set with open permissions: ugo+rw
Jul 03 13:08:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:23 devstack sudo[104433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d
Jul 03 13:08:23 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:24 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d" returned: 0 in 0.695s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-quobyte-0662b957-fe4e-462f-9bd9-19905e73f24d" released by "_copy_volume_from_snapshot" :: held 10.505s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "cinder-quobyte-fb4dbf38-7585-4361-b03a-94d638fd843c" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-quobyte-fb4dbf38-7585-4361-b03a-94d638fd843c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Deleting offline snapshot fb4dbf38-7585-4361-b03a-94d638fd843c of volume bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:08:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] snapshot_file for this snap is: volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:08:24 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d13ead-30f2-4ce4-b4d9-9206992712b6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:24 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c
Jul 03 13:08:24 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:24 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c" returned: 0 in 0.776s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:08:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[31be8fad-a98e-4668-b1d4-61bc0a43cffc]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:25 devstack sudo[104441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5
Jul 03 13:08:25 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:25 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5" returned: 0 in 0.761s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:25 devstack sudo[104446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c
Jul 03 13:08:25 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:26 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c" returned: 0 in 0.800s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:26 devstack sudo[104451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c
Jul 03 13:08:26 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:27 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5.fb4dbf38-7585-4361-b03a-94d638fd843c" returned: 0 in 0.772s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-quobyte-fb4dbf38-7585-4361-b03a-94d638fd843c" released by "_delete_snapshot" :: held 3.208s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.646s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b62777-aaab-4342-b66d-280eff131c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0662b957-fe4e-462f-9bd9-19905e73f24d', 'volume_size': 2, 'source_volid': 'bd99fb75-98ee-4e1d-93ee-b22c4115d7b5', 'source_volstatus': 'available'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0ff7f2-6b4d-4b18-82a4-4747d517a079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Volume volume-0662b957-fe4e-462f-9bd9-19905e73f24d (0662b957-fe4e-462f-9bd9-19905e73f24d): created successfully
Jul 03 13:08:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0ff7f2-6b4d-4b18-82a4-4747d517a079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Flow 'volume_create_manager' (fd34bd17-cf06-4d4e-9e3a-dcca69b6edbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-00b8c480-8b65-4aab-a02b-10b95f0f7ca1 tempest-VolumesCloneTest-1440546339 None] Created volume successfully.
Jul 03 13:08:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "cinder-0662b957-fe4e-462f-9bd9-19905e73f24d-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-0662b957-fe4e-462f-9bd9-19905e73f24d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "cinder-quobyte-0662b957-fe4e-462f-9bd9-19905e73f24d" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-quobyte-0662b957-fe4e-462f-9bd9-19905e73f24d" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:29 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4876db8-3db7-407e-b2e8-c86757e3b758]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:29 devstack sudo[104454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d
Jul 03 13:08:29 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:29 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d" returned: 0 in 0.874s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:29 devstack sudo[104459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d
Jul 03 13:08:29 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:30 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0662b957-fe4e-462f-9bd9-19905e73f24d" returned: 0 in 0.747s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-quobyte-0662b957-fe4e-462f-9bd9-19905e73f24d" released by "delete_volume" :: held 1.671s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Created reservations ['9e09f111-b18b-4a44-82e1-ea07ee7e9cfb', '99269711-161c-43d5-aad8-efd043ae1f1e', 'd208578f-87e6-426e-bffd-d7c24e44f6ac', '2a4b06d7-6149-4276-a6f4-00c4f763c957'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:30 devstack sudo[104463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:08:30 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "cinder-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "cinder-quobyte-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-quobyte-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f00e20-30be-44dc-86fc-4876f1cdee38]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:31 devstack sudo[104469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5
Jul 03 13:08:31 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:31 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.777s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:31 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:08:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Deleted volume successfully.
Jul 03 13:08:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e1072c7b-3a38-4e06-a800-caf6a9a885a9 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-0662b957-fe4e-462f-9bd9-19905e73f24d-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:32 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5" returned: 0 in 0.810s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:32 devstack sudo[104478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5
Jul 03 13:08:32 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:32 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5" returned: 0 in 0.638s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-quobyte-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5" released by "delete_volume" :: held 1.516s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:32 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Created reservations ['dc7e61d5-9659-46ff-a825-b2310abc79a9', 'bda3be61-8fb5-40a5-8d61-ca363f3b22cd', '8fc67996-b39d-45ca-b6d9-8648d1a45f2d', '89f8aab0-2c09-4e42-a611-9a3d15418498'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:32 devstack sudo[104481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:08:33 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:33 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.694s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:08:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Deleted volume successfully.
Jul 03 13:08:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8ad7bb06-f563-4f26-a993-cba785b5fe78 tempest-VolumesCloneTest-1440546339 None] Lock "cinder-bd99fb75-98ee-4e1d-93ee-b22c4115d7b5-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d5e48279-2f5e-4060-8ec8-b60b25a4147a req-29e39e12-bfa3-456c-9c0c-598d8116a6e0 tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d5e48279-2f5e-4060-8ec8-b60b25a4147a req-29e39e12-bfa3-456c-9c0c-598d8116a6e0 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[085d38a6-bb72-4305-8b71-b2b576ed2fc2]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-d5e48279-2f5e-4060-8ec8-b60b25a4147a req-29e39e12-bfa3-456c-9c0c-598d8116a6e0 tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:34 devstack sudo[104492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd
Jul 03 13:08:34 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:35 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-d5e48279-2f5e-4060-8ec8-b60b25a4147a req-29e39e12-bfa3-456c-9c0c-598d8116a6e0 tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd" returned: 0 in 0.860s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d5e48279-2f5e-4060-8ec8-b60b25a4147a req-29e39e12-bfa3-456c-9c0c-598d8116a6e0 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.881s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-d5e48279-2f5e-4060-8ec8-b60b25a4147a req-29e39e12-bfa3-456c-9c0c-598d8116a6e0 tempest-TestInstancesWithCinderVolumes-506737802 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-7755a283-d858-4916-92b6-80f84f3f50cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa7a3727-1bc2-41a6-a536-cf3061e465c0', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:08:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-d5e48279-2f5e-4060-8ec8-b60b25a4147a req-29e39e12-bfa3-456c-9c0c-598d8116a6e0 tempest-TestInstancesWithCinderVolumes-506737802 None] attachment_update completed successfully.
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Flow 'volume_create_manager' (f6e46d08-310b-4072-b437-5bca7188e01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61fe40ba-eded-463b-851f-a7ecb7ada3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61fe40ba-eded-463b-851f-a7ecb7ada3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-756385512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75eb8e4-4c01-44dd-b536-1482e951fa18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37b4706aecc74e559a16dd27a10d5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:37Z,use_quota=True,user_id='c488c5f65a924f60a099adb8da85d789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfc30cc-520b-4f22-8a32-36e24c646c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfc30cc-520b-4f22-8a32-36e24c646c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7b80ba-c5a3-4046-9989-fa30af6938f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7b80ba-c5a3-4046-9989-fa30af6938f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a75eb8e4-4c01-44dd-b536-1482e951fa18', 'volume_name': 'volume-a75eb8e4-4c01-44dd-b536-1482e951fa18', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b1f542-d2c1-4eca-9d63-6b005c07f24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b1f542-d2c1-4eca-9d63-6b005c07f24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cf83a7-f3a7-4dac-8716-5638dbcdc2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:36 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Volume a75eb8e4-4c01-44dd-b536-1482e951fa18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a75eb8e4-4c01-44dd-b536-1482e951fa18', 'volume_size': 1}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-756385512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75eb8e4-4c01-44dd-b536-1482e951fa18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37b4706aecc74e559a16dd27a10d5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:37Z,use_quota=True,user_id='c488c5f65a924f60a099adb8da85d789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Creating volume a75eb8e4-4c01-44dd-b536-1482e951fa18 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:08:36 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:08:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:36 devstack sudo[104499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18 1073741824
Jul 03 13:08:36 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:37 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18 1073741824" returned: 0 in 0.999s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:37 devstack sudo[104505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18
Jul 03 13:08:37 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:38 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18" returned: 0 in 0.751s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:08:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cf83a7-f3a7-4dac-8716-5638dbcdc2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a75eb8e4-4c01-44dd-b536-1482e951fa18', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed8a62e-3c63-40ba-87b0-0cee33dc91f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Volume volume-a75eb8e4-4c01-44dd-b536-1482e951fa18 (a75eb8e4-4c01-44dd-b536-1482e951fa18): created successfully
Jul 03 13:08:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed8a62e-3c63-40ba-87b0-0cee33dc91f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Flow 'volume_create_manager' (f6e46d08-310b-4072-b437-5bca7188e01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ea1b2987-959e-439f-8a84-092a22d9c5f5 tempest-VolumesListTestJSON-51366926 None] Created volume successfully.
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Flow 'volume_create_manager' (1bcc3f1e-42ca-4617-89f2-67058436a438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305a0cbc-f87d-4125-b54f-bf5ce114f8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305a0cbc-f87d-4125-b54f-bf5ce114f8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2050060285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad14b730-c345-4293-bf44-421121aca1da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37b4706aecc74e559a16dd27a10d5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:39Z,use_quota=True,user_id='c488c5f65a924f60a099adb8da85d789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd55285c-ade6-4ede-8693-c1921cce0c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd55285c-ade6-4ede-8693-c1921cce0c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d23af6-fca2-429c-a6f0-6f0eebc5a0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d23af6-fca2-429c-a6f0-6f0eebc5a0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad14b730-c345-4293-bf44-421121aca1da', 'volume_name': 'volume-ad14b730-c345-4293-bf44-421121aca1da', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32b90c9-85e4-4481-a816-acb8cad5c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32b90c9-85e4-4481-a816-acb8cad5c68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573fce0d-83f8-4262-aa00-1115264835e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:39 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Volume ad14b730-c345-4293-bf44-421121aca1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad14b730-c345-4293-bf44-421121aca1da', 'volume_size': 1}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2050060285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad14b730-c345-4293-bf44-421121aca1da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37b4706aecc74e559a16dd27a10d5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:39Z,use_quota=True,user_id='c488c5f65a924f60a099adb8da85d789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Creating volume ad14b730-c345-4293-bf44-421121aca1da {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:08:39 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:08:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:39 devstack sudo[104508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da 1073741824
Jul 03 13:08:39 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:40 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da 1073741824" returned: 0 in 0.933s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:40 devstack sudo[104523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da
Jul 03 13:08:40 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:41 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da" returned: 0 in 0.667s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:41 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:08:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573fce0d-83f8-4262-aa00-1115264835e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad14b730-c345-4293-bf44-421121aca1da', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031b18b0-406d-412e-8370-eeb373b50546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:41 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Volume volume-ad14b730-c345-4293-bf44-421121aca1da (ad14b730-c345-4293-bf44-421121aca1da): created successfully
Jul 03 13:08:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031b18b0-406d-412e-8370-eeb373b50546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Flow 'volume_create_manager' (1bcc3f1e-42ca-4617-89f2-67058436a438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:41 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c6d84d12-a2e0-4c7c-9034-0870fc0c5226 tempest-VolumesListTestJSON-51366926 None] Created volume successfully.
Jul 03 13:08:41 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:08:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Flow 'volume_create_manager' (3bbdaf43-ba4f-426f-bdc3-0aa6214544e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63068fa-9952-4c39-8684-6ef7ec8936fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63068fa-9952-4c39-8684-6ef7ec8936fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1009505236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3584838d-86de-446c-86ea-f68c0926435e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37b4706aecc74e559a16dd27a10d5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:42Z,use_quota=True,user_id='c488c5f65a924f60a099adb8da85d789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c7a200-54d9-48bf-ba7e-48a81ca4e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c7a200-54d9-48bf-ba7e-48a81ca4e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d602e0cc-9357-4999-b1de-d3db95c2970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d602e0cc-9357-4999-b1de-d3db95c2970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3584838d-86de-446c-86ea-f68c0926435e', 'volume_name': 'volume-3584838d-86de-446c-86ea-f68c0926435e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af01b57c-c02d-4f02-9cd5-d2778c5c85c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af01b57c-c02d-4f02-9cd5-d2778c5c85c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9fb15c-dcb9-4c78-ac52-4e7520aee6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:42 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Volume 3584838d-86de-446c-86ea-f68c0926435e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3584838d-86de-446c-86ea-f68c0926435e', 'volume_size': 1}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1009505236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3584838d-86de-446c-86ea-f68c0926435e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37b4706aecc74e559a16dd27a10d5738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:42Z,use_quota=True,user_id='c488c5f65a924f60a099adb8da85d789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Creating volume 3584838d-86de-446c-86ea-f68c0926435e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:08:42 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:08:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:42 devstack sudo[104527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e 1073741824
Jul 03 13:08:42 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:43 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e 1073741824" returned: 0 in 0.969s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:43 devstack sudo[104533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e
Jul 03 13:08:43 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-42ea7b16-ab8d-4157-84bf-3035438fa6c4 req-667e46e0-8f2e-4147-97cf-448c71f83f13 tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:43 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e" returned: 0 in 0.734s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-42ea7b16-ab8d-4157-84bf-3035438fa6c4 req-667e46e0-8f2e-4147-97cf-448c71f83f13 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.465s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9fb15c-dcb9-4c78-ac52-4e7520aee6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3584838d-86de-446c-86ea-f68c0926435e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc7f96a-f804-48f1-acfa-04d3b79b3f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d17a2d-fbbd-4e91-8d99-701f43cbb6c2]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-42ea7b16-ab8d-4157-84bf-3035438fa6c4 req-667e46e0-8f2e-4147-97cf-448c71f83f13 tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Volume volume-3584838d-86de-446c-86ea-f68c0926435e (3584838d-86de-446c-86ea-f68c0926435e): created successfully
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc7f96a-f804-48f1-acfa-04d3b79b3f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Flow 'volume_create_manager' (3bbdaf43-ba4f-426f-bdc3-0aa6214544e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-65855af0-858f-42bb-94df-e74893ef980e tempest-VolumesListTestJSON-51366926 None] Created volume successfully.
Jul 03 13:08:43 devstack sudo[104544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e
Jul 03 13:08:43 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:44 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-42ea7b16-ab8d-4157-84bf-3035438fa6c4 req-667e46e0-8f2e-4147-97cf-448c71f83f13 tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e" returned: 0 in 0.871s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-42ea7b16-ab8d-4157-84bf-3035438fa6c4 req-667e46e0-8f2e-4147-97cf-448c71f83f13 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.903s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-42ea7b16-ab8d-4157-84bf-3035438fa6c4 req-667e46e0-8f2e-4147-97cf-448c71f83f13 tempest-TestInstancesWithCinderVolumes-506737802 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-11f0e083-729a-42dc-89a0-ac535b9b007e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '581aaa80-0239-4ba7-a1c6-76317446dfb0', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:08:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-42ea7b16-ab8d-4157-84bf-3035438fa6c4 req-667e46e0-8f2e-4147-97cf-448c71f83f13 tempest-TestInstancesWithCinderVolumes-506737802 None] attachment_update completed successfully.
Jul 03 13:08:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Acquiring lock "cinder-3584838d-86de-446c-86ea-f68c0926435e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Lock "cinder-3584838d-86de-446c-86ea-f68c0926435e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Acquiring lock "cinder-quobyte-3584838d-86de-446c-86ea-f68c0926435e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Lock "cinder-quobyte-3584838d-86de-446c-86ea-f68c0926435e" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:46 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[64435ee4-da46-416c-b01c-5f752660752d]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:46 devstack sudo[104551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e
Jul 03 13:08:46 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:47 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e" returned: 0 in 0.741s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:47 devstack sudo[104556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e
Jul 03 13:08:47 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:47 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3584838d-86de-446c-86ea-f68c0926435e" returned: 0 in 0.679s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Lock "cinder-quobyte-3584838d-86de-446c-86ea-f68c0926435e" released by "delete_volume" :: held 1.465s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:47 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Created reservations ['07226163-e76f-4842-8652-6e83e9326365', 'e745ed86-e685-499f-8ef2-eebbe6c79f91', '25c373ad-0fd2-4927-977e-de567e0e9edf', '88f151a4-9e49-418e-895f-eb935e6dc962'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:48 devstack sudo[104559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:08:48 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Acquiring lock "cinder-ad14b730-c345-4293-bf44-421121aca1da-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:48 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Lock "cinder-ad14b730-c345-4293-bf44-421121aca1da-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.711s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:08:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Deleted volume successfully.
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4e3daf4f-4aa9-497f-af7e-699189b956cb tempest-VolumesListTestJSON-51366926 None] Lock "cinder-3584838d-86de-446c-86ea-f68c0926435e-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Acquiring lock "cinder-quobyte-ad14b730-c345-4293-bf44-421121aca1da" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Lock "cinder-quobyte-ad14b730-c345-4293-bf44-421121aca1da" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1c0551-2600-45af-85fb-88476de97d49]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:49 devstack sudo[104563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da
Jul 03 13:08:49 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:49 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da" returned: 0 in 0.868s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:49 devstack sudo[104577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da
Jul 03 13:08:49 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:50 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ad14b730-c345-4293-bf44-421121aca1da" returned: 0 in 0.742s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Lock "cinder-quobyte-ad14b730-c345-4293-bf44-421121aca1da" released by "delete_volume" :: held 1.653s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:50 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Created reservations ['2e2a6108-c97c-4257-ac7f-00ab89278ee3', '9a02fb94-aa5f-4d65-b231-6761cbe28f2c', '3e59f4b7-48fc-4491-9084-7b59a2e8f01d', '006c0e55-3be4-4840-8e8d-1bdc8a48379e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:50 devstack sudo[104582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:08:50 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Acquiring lock "cinder-a75eb8e4-4c01-44dd-b536-1482e951fa18-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Lock "cinder-a75eb8e4-4c01-44dd-b536-1482e951fa18-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Acquiring lock "cinder-quobyte-a75eb8e4-4c01-44dd-b536-1482e951fa18" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Lock "cinder-quobyte-a75eb8e4-4c01-44dd-b536-1482e951fa18" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:51 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1dae3d-f06e-41eb-9546-ef9781bb2d5e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:51 devstack sudo[104584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18
Jul 03 13:08:51 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:51 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.737s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:51 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:08:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Deleted volume successfully.
Jul 03 13:08:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-fd86187d-eb22-4cc0-a282-47927c845296 tempest-VolumesListTestJSON-51366926 None] Lock "cinder-ad14b730-c345-4293-bf44-421121aca1da-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:52 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18" returned: 0 in 0.903s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:52 devstack sudo[104601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18
Jul 03 13:08:52 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:52 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a75eb8e4-4c01-44dd-b536-1482e951fa18" returned: 0 in 0.765s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Lock "cinder-quobyte-a75eb8e4-4c01-44dd-b536-1482e951fa18" released by "delete_volume" :: held 1.714s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:52 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Created reservations ['c0beb622-2f1d-47c3-9bd9-ba8e931bd5ac', 'ccd74ed0-d55a-4a1a-b886-a57b2998bdc2', '082fde2a-6bd4-42de-a0e8-781c22d8d92f', 'c8dc60c8-da2b-4f66-baad-42e4bb575fc7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:53 devstack sudo[104616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:08:53 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:53 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.711s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:53 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:08:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Deleted volume successfully.
Jul 03 13:08:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-541d401f-d906-4269-9272-8f36370d2e33 tempest-VolumesListTestJSON-51366926 None] Lock "cinder-a75eb8e4-4c01-44dd-b536-1482e951fa18-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-9c94f459-7406-4f31-99d4-bcbb860a8c03 req-6e77e1e5-30ca-476f-b56c-5c6c30a6c656 tempest-TestInstancesWithCinderVolumes-506737802 None] Terminate volume connection completed successfully.
Jul 03 13:08:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-9c94f459-7406-4f31-99d4-bcbb860a8c03 req-6e77e1e5-30ca-476f-b56c-5c6c30a6c656 tempest-TestInstancesWithCinderVolumes-506737802 None] Deleting attachment aa7a3727-1bc2-41a6-a536-cf3061e465c0. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:08:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "cinder-7755a283-d858-4916-92b6-80f84f3f50cd-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-7755a283-d858-4916-92b6-80f84f3f50cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "cinder-quobyte-7755a283-d858-4916-92b6-80f84f3f50cd" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-quobyte-7755a283-d858-4916-92b6-80f84f3f50cd" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:56 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b59490e-e502-43f3-a95e-21002bc8ac00]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:56 devstack sudo[104626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd
Jul 03 13:08:56 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:57 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd" returned: 0 in 1.161s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:57 devstack sudo[104632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd
Jul 03 13:08:57 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:58 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7755a283-d858-4916-92b6-80f84f3f50cd" returned: 0 in 0.780s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-quobyte-7755a283-d858-4916-92b6-80f84f3f50cd" released by "delete_volume" :: held 1.989s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:58 devstack cinder-volume[86763]: WARNING cinder.quota [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1579339893-2073797922 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1579339893-2073797922, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:08:58 devstack cinder-volume[86763]: WARNING cinder.quota [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1579339893-2073797922 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1579339893-2073797922, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:08:58 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Created reservations ['f1fb5f14-95dc-4733-8387-6d07986f775b', 'efc66f7c-894e-4b00-82ea-275d9ede3720', '181a449a-8dc5-4bc7-a0ed-36989f1df321', '49ee0435-8c55-407b-baaf-b9f622006cae'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:58 devstack sudo[104636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:08:58 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:59 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.825s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:59 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:08:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Deleted volume successfully.
Jul 03 13:08:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3266b06f-af1b-4abf-b76c-3ec56ef7943c tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-7755a283-d858-4916-92b6-80f84f3f50cd-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-acb9ccbf-f5a3-4ca2-ab4b-da33fe00b3d0 req-43c7f959-2fca-44a3-9dd7-6db2201e4a93 tempest-TestInstancesWithCinderVolumes-506737802 None] Terminate volume connection completed successfully.
Jul 03 13:09:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-acb9ccbf-f5a3-4ca2-ab4b-da33fe00b3d0 req-43c7f959-2fca-44a3-9dd7-6db2201e4a93 tempest-TestInstancesWithCinderVolumes-506737802 None] Deleting attachment 581aaa80-0239-4ba7-a1c6-76317446dfb0. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:09:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "cinder-11f0e083-729a-42dc-89a0-ac535b9b007e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-11f0e083-729a-42dc-89a0-ac535b9b007e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "cinder-quobyte-11f0e083-729a-42dc-89a0-ac535b9b007e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-quobyte-11f0e083-729a-42dc-89a0-ac535b9b007e" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f42929d-e0fc-4763-95c8-052fd3d3a166]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:04 devstack sudo[104702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e
Jul 03 13:09:04 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:09:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:05 devstack sudo[104713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:09:05 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:05 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e" returned: 0 in 0.932s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:05 devstack sudo[104715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e
Jul 03 13:09:05 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:06 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.941s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:09:06 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-11f0e083-729a-42dc-89a0-ac535b9b007e" returned: 0 in 1.159s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-quobyte-11f0e083-729a-42dc-89a0-ac535b9b007e" released by "delete_volume" :: held 2.181s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:06 devstack cinder-volume[86763]: WARNING cinder.quota [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-82887582-1381645173 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-82887582-1381645173, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:09:06 devstack cinder-volume[86763]: WARNING cinder.quota [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-82887582-1381645173 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-82887582-1381645173, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:09:06 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Created reservations ['7818c6c6-e314-4a89-989d-45381d451493', 'd4cfb508-d422-40c8-a18f-ecbc36b06557', 'a10a9c7a-5689-4527-9529-12e2fdc58bf8', 'bfbeef95-eee4-4986-b53c-615582801a31'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:06 devstack sudo[104720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:09:06 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:07 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.903s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:07 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:09:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Deleted volume successfully.
Jul 03 13:09:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-57cbf669-5ecc-4453-824c-32edf3bbb622 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-11f0e083-729a-42dc-89a0-ac535b9b007e-delete_volume" released by "delete_volume" :: held 3.409s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Flow 'volume_create_manager' (89b4f54e-00ec-49ff-92f1-52c0e7ce440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268659af-1490-472d-aee9-718fb45fa5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268659af-1490-472d-aee9-718fb45fa5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1037222085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a5265c-de88-498c-b589-cc6f440f68cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971ef7981734719b8a3126c3e50b893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:09Z,use_quota=True,user_id='53539d0d443a454f89227041fb0db8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea23390-5001-457b-a31e-27e8e183a14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea23390-5001-457b-a31e-27e8e183a14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e424b9a-6eba-400d-a471-00fef9c70aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e424b9a-6eba-400d-a471-00fef9c70aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75a5265c-de88-498c-b589-cc6f440f68cc', 'volume_name': 'volume-75a5265c-de88-498c-b589-cc6f440f68cc', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6653f84f-a37d-490c-8c44-9cf3330f342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6653f84f-a37d-490c-8c44-9cf3330f342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6123ce-4352-4a02-a623-3636d0e5d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:09 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume 75a5265c-de88-498c-b589-cc6f440f68cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75a5265c-de88-498c-b589-cc6f440f68cc', 'volume_size': 1}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1037222085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a5265c-de88-498c-b589-cc6f440f68cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971ef7981734719b8a3126c3e50b893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:09Z,use_quota=True,user_id='53539d0d443a454f89227041fb0db8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Creating volume 75a5265c-de88-498c-b589-cc6f440f68cc {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:09:09 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:09:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:09 devstack sudo[104760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc 1073741824
Jul 03 13:09:09 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:10 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc 1073741824" returned: 0 in 1.028s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:10 devstack sudo[104770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc
Jul 03 13:09:10 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:11 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc" returned: 0 in 0.779s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:09:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6123ce-4352-4a02-a623-3636d0e5d415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a5265c-de88-498c-b589-cc6f440f68cc', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec30ac48-806a-4ef3-a629-6ef92c80e287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume volume-75a5265c-de88-498c-b589-cc6f440f68cc (75a5265c-de88-498c-b589-cc6f440f68cc): created successfully
Jul 03 13:09:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec30ac48-806a-4ef3-a629-6ef92c80e287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Flow 'volume_create_manager' (89b4f54e-00ec-49ff-92f1-52c0e7ce440c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b4bc2e42-bae4-4b93-8352-71f6e4ce15c4 tempest-VolumesSnapshotTestJSON-1180596588 None] Created volume successfully.
Jul 03 13:09:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-cb3a021a-ac36-479e-b3e2-d7af64bfe912 req-dcfd021f-fb58-488e-96cd-b72ade03e767 tempest-TestInstancesWithCinderVolumes-506737802 None] Terminate volume connection completed successfully.
Jul 03 13:09:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-cb3a021a-ac36-479e-b3e2-d7af64bfe912 req-dcfd021f-fb58-488e-96cd-b72ade03e767 tempest-TestInstancesWithCinderVolumes-506737802 None] Deleting attachment f1387dce-f5c8-4b73-9123-7db6c7282ff5. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:09:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] Creating offline snapshot 0c42da56-dcfc-434e-99ea-309e6f6d1356 of volume 75a5265c-de88-498c-b589-cc6f440f68cc {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:09:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecefff8-c7a9-47d0-8b9c-b206f5c6d26c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:12 devstack sudo[104774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc
Jul 03 13:09:12 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:13 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc" returned: 0 in 0.772s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:13 devstack sudo[104779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356 1G
Jul 03 13:09:13 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:14 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356 1G" returned: 0 in 0.981s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75a5265c-de88-498c-b589-cc6f440f68cc -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:14 devstack sudo[104786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75a5265c-de88-498c-b589-cc6f440f68cc -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356
Jul 03 13:09:14 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:15 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75a5265c-de88-498c-b589-cc6f440f68cc -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356" returned: 0 in 0.739s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:15 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356 is being set with open permissions: ugo+rw
Jul 03 13:09:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:15 devstack sudo[104791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356
Jul 03 13:09:15 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "cinder-6701172b-2fb3-40b5-8a63-2f180f554a9d-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-6701172b-2fb3-40b5-8a63-2f180f554a9d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "cinder-quobyte-6701172b-2fb3-40b5-8a63-2f180f554a9d" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-quobyte-6701172b-2fb3-40b5-8a63-2f180f554a9d" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c943198d-8a8b-46ef-b14c-4e9754eeadbc]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:16 devstack sudo[104793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d
Jul 03 13:09:16 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:16 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356" returned: 0 in 0.749s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:16 devstack sudo[104796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.info
Jul 03 13:09:16 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:16 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d" returned: 0 in 0.929s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:16 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.info" returned: 0 in 0.803s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:16 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.info is being set with open permissions: ugo+rw
Jul 03 13:09:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:16 devstack sudo[104802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.info
Jul 03 13:09:16 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:16 devstack sudo[104801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d
Jul 03 13:09:16 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:17 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d" returned: 1 in 0.876s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:09:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:17 devstack sudo[104809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d
Jul 03 13:09:17 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:17 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.info" returned: 0 in 0.882s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.028s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7e896db0-1ee5-453b-9629-9e9cef5cd5c3 tempest-VolumesSnapshotTestJSON-1180596588 None] Create snapshot completed successfully
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-0c42da56-dcfc-434e-99ea-309e6f6d1356-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-0c42da56-dcfc-434e-99ea-309e6f6d1356-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-75a5265c-de88-498c-b589-cc6f440f68cc" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-75a5265c-de88-498c-b589-cc6f440f68cc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-0c42da56-dcfc-434e-99ea-309e6f6d1356" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-0c42da56-dcfc-434e-99ea-309e6f6d1356" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Deleting offline snapshot 0c42da56-dcfc-434e-99ea-309e6f6d1356 of volume 75a5265c-de88-498c-b589-cc6f440f68cc {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] snapshot_file for this snap is: volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d999c2-aa5f-4159-8d39-748a441d6d32]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:18 devstack sudo[104811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356
Jul 03 13:09:18 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:18 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6701172b-2fb3-40b5-8a63-2f180f554a9d" returned: 0 in 0.742s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-quobyte-6701172b-2fb3-40b5-8a63-2f180f554a9d" released by "delete_volume" :: held 2.638s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:18 devstack cinder-volume[86763]: WARNING cinder.quota [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-643674772-1417956587 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-643674772-1417956587, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:09:18 devstack cinder-volume[86763]: WARNING cinder.quota [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-643674772-1417956587 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-643674772-1417956587, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Created reservations ['8fe70f05-d8fc-435a-9964-933fb3828762', 'd9273e81-f62c-4e72-9816-d4a99bfc0b6e', '83cf43db-faea-423b-b8c0-6b984a51aadc', '5acdd980-a6a2-4606-a380-b33d4089317b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:18 devstack sudo[104814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:09:18 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:19 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356" returned: 0 in 0.868s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75a5265c-de88-498c-b589-cc6f440f68cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:09:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1afdff-4484-4a62-b286-8d5f6a0824c2]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:19 devstack sudo[104819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc
Jul 03 13:09:19 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:19 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.788s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:09:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Deleted volume successfully.
Jul 03 13:09:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-09599b6c-b54c-4c6d-b89d-772605915c59 tempest-TestInstancesWithCinderVolumes-506737802 None] Lock "cinder-6701172b-2fb3-40b5-8a63-2f180f554a9d-delete_volume" released by "delete_volume" :: held 3.689s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:20 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc" returned: 0 in 0.950s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:20 devstack sudo[104825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356
Jul 03 13:09:20 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:21 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356" returned: 0 in 0.852s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:21 devstack sudo[104832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356
Jul 03 13:09:21 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:21 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc.0c42da56-dcfc-434e-99ea-309e6f6d1356" returned: 0 in 0.711s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-0c42da56-dcfc-434e-99ea-309e6f6d1356" released by "_delete_snapshot" :: held 3.501s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-75a5265c-de88-498c-b589-cc6f440f68cc" released by "delete_snapshot" :: held 3.526s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Created reservations ['fccb4eef-b265-4b62-a1ed-b51f28b388ad', 'bfae9e32-bb40-4315-97a5-e841439e58fd', 'e2a806d3-89fa-40a2-ab03-c143bba0f5ae', '2a5e2d38-3ffa-4718-9e22-6ca97674eea1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Delete snapshot completed successfully.
Jul 03 13:09:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0f96cbd-ac4c-4a00-b3cf-4ab60e773f2b tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-0c42da56-dcfc-434e-99ea-309e6f6d1356-delete_snapshot" released by "delete_snapshot" :: held 3.772s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=82,cinder:INSERT=23,cinder:SELECT=88,cinder:DELETE=7 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=100,cinder:SELECT=70,cinder:DELETE=7,cinder:INSERT=19 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Flow 'volume_create_manager' (b754de75-22e3-4da0-bac1-a49615b657c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9259cd82-b2e5-41d1-b1d0-1ae98baf2fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9259cd82-b2e5-41d1-b1d0-1ae98baf2fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-112537440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d10c83c-e864-4d5f-aead-6e1b7f769192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971ef7981734719b8a3126c3e50b893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:23Z,use_quota=True,user_id='53539d0d443a454f89227041fb0db8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21868905-eac2-442d-85d7-0a3c4a4e9487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21868905-eac2-442d-85d7-0a3c4a4e9487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61010961-331d-4738-a783-59851eac1e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61010961-331d-4738-a783-59851eac1e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d10c83c-e864-4d5f-aead-6e1b7f769192', 'volume_name': 'volume-4d10c83c-e864-4d5f-aead-6e1b7f769192', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6170f2-1fd2-4ee9-8436-03fdd6023341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6170f2-1fd2-4ee9-8436-03fdd6023341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3352f9-018f-4ca3-aae1-cf9dc9dbd625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume 4d10c83c-e864-4d5f-aead-6e1b7f769192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d10c83c-e864-4d5f-aead-6e1b7f769192', 'volume_size': 1}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-112537440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d10c83c-e864-4d5f-aead-6e1b7f769192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971ef7981734719b8a3126c3e50b893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:23Z,use_quota=True,user_id='53539d0d443a454f89227041fb0db8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Creating volume 4d10c83c-e864-4d5f-aead-6e1b7f769192 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:09:23 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:09:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:23 devstack sudo[104836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 1073741824
Jul 03 13:09:23 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:24 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 1073741824" returned: 0 in 0.985s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:24 devstack sudo[104842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192
Jul 03 13:09:24 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:24 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192" returned: 0 in 0.711s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:09:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3352f9-018f-4ca3-aae1-cf9dc9dbd625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d10c83c-e864-4d5f-aead-6e1b7f769192', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d19c2cc-da24-402b-9891-a9f36c1cc023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:24 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 (4d10c83c-e864-4d5f-aead-6e1b7f769192): created successfully
Jul 03 13:09:24 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d19c2cc-da24-402b-9891-a9f36c1cc023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Flow 'volume_create_manager' (b754de75-22e3-4da0-bac1-a49615b657c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ff2f8809-0090-442e-8d7c-ef7025dffeb3 tempest-VolumesSnapshotTestJSON-1180596588 None] Created volume successfully.
Jul 03 13:09:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] Creating offline snapshot 714da649-4f8f-4a29-8a7c-6100e8533b50 of volume 4d10c83c-e864-4d5f-aead-6e1b7f769192 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:09:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b20e014-9509-4005-b11b-840208a303a1]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:25 devstack sudo[104846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192
Jul 03 13:09:25 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:26 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192" returned: 0 in 0.879s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:26 devstack sudo[104851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50 1G
Jul 03 13:09:26 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:27 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50 1G" returned: 0 in 0.859s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:27 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50
Jul 03 13:09:27 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:27 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50" returned: 0 in 0.799s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:27 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50 is being set with open permissions: ugo+rw
Jul 03 13:09:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:28 devstack sudo[104862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50
Jul 03 13:09:28 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50" returned: 0 in 0.729s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:28 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:28 devstack sudo[104866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.info
Jul 03 13:09:28 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:29 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.info" returned: 0 in 0.823s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:29 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.info is being set with open permissions: ugo+rw
Jul 03 13:09:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:29 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.info
Jul 03 13:09:29 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:30 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.info" returned: 0 in 0.776s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.976s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-76c583d6-5e1b-461d-9a94-2be028e7ce81 tempest-VolumesSnapshotTestJSON-1180596588 None] Create snapshot completed successfully
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Flow 'volume_create_manager' (b7079bad-946b-474c-8dcb-4fb1c354f1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c8eab5-2b27-476e-9cfb-b6a2c65c1781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c8eab5-2b27-476e-9cfb-b6a2c65c1781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-300202588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bcbdb3-9583-4dea-905e-295debca4c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971ef7981734719b8a3126c3e50b893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=714da649-4f8f-4a29-8a7c-6100e8533b50,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:31Z,use_quota=True,user_id='53539d0d443a454f89227041fb0db8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e50775-2e21-4c2a-8d9d-5eac73ca0722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e50775-2e21-4c2a-8d9d-5eac73ca0722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad97fd22-58bd-4d55-960e-635d5aa0cb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad97fd22-58bd-4d55-960e-635d5aa0cb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6bcbdb3-9583-4dea-905e-295debca4c81', 'volume_name': 'volume-e6bcbdb3-9583-4dea-905e-295debca4c81', 'volume_size': 2, 'snapshot_id': '714da649-4f8f-4a29-8a7c-6100e8533b50'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f1384a-f841-4999-9580-6992fcd68847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f1384a-f841-4999-9580-6992fcd68847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad5abd8-2c4b-4e7e-9445-d50e059d9c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume e6bcbdb3-9583-4dea-905e-295debca4c81: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6bcbdb3-9583-4dea-905e-295debca4c81', 'volume_size': 2, 'snapshot_id': '714da649-4f8f-4a29-8a7c-6100e8533b50'}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-714da649-4f8f-4a29-8a7c-6100e8533b50-e6bcbdb3-9583-4dea-905e-295debca4c81" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-714da649-4f8f-4a29-8a7c-6100e8533b50-e6bcbdb3-9583-4dea-905e-295debca4c81" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Creating volume e6bcbdb3-9583-4dea-905e-295debca4c81 from snapshot 714da649-4f8f-4a29-8a7c-6100e8533b50 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-e6bcbdb3-9583-4dea-905e-295debca4c81" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-e6bcbdb3-9583-4dea-905e-295debca4c81" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] snapshot: 714da649-4f8f-4a29-8a7c-6100e8533b50, volume: e6bcbdb3-9583-4dea-905e-295debca4c81,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0903f9-6aac-48bc-a85d-c196a6fb1859]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:31 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50
Jul 03 13:09:31 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:32 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50" returned: 0 in 0.851s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d10c83c-e864-4d5f-aead-6e1b7f769192(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:09:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:09:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:09:32 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5c7452-8d1e-429f-81a3-73d416ffb01e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:32 devstack sudo[104878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192
Jul 03 13:09:32 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:33 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192" returned: 0 in 0.945s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:33 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 13:09:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:33 devstack sudo[104884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81
Jul 03 13:09:33 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:38 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81" returned: 0 in 5.242s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07aed6b-c3a7-4f9e-812e-0178ae860a21]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:38 devstack sudo[104897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192
Jul 03 13:09:38 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:39 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192" returned: 0 in 1.103s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:39 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:09:39 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Converted 1024.00 MB image at 195.30 MB/s
Jul 03 13:09:39 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81 is being set with open permissions: ugo+rw
Jul 03 13:09:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:39 devstack sudo[104902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81
Jul 03 13:09:39 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:40 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81" returned: 0 in 0.868s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-e6bcbdb3-9583-4dea-905e-295debca4c81" released by "_copy_volume_from_snapshot" :: held 9.120s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-714da649-4f8f-4a29-8a7c-6100e8533b50-e6bcbdb3-9583-4dea-905e-295debca4c81" released by "_create_volume_from_snapshot" :: held 9.155s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.180s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad5abd8-2c4b-4e7e-9445-d50e059d9c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6bcbdb3-9583-4dea-905e-295debca4c81', 'volume_size': 2, 'snapshot_id': '714da649-4f8f-4a29-8a7c-6100e8533b50'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6832f8a-0d91-4772-9e91-645980f558c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:40 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume volume-e6bcbdb3-9583-4dea-905e-295debca4c81 (e6bcbdb3-9583-4dea-905e-295debca4c81): created successfully
Jul 03 13:09:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6832f8a-0d91-4772-9e91-645980f558c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Flow 'volume_create_manager' (b7079bad-946b-474c-8dcb-4fb1c354f1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3f2a4021-c02a-43a0-b40d-adbc667e1cf1 tempest-VolumesSnapshotTestJSON-1180596588 None] Created volume successfully.
Jul 03 13:09:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-e6bcbdb3-9583-4dea-905e-295debca4c81-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-e6bcbdb3-9583-4dea-905e-295debca4c81-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-e6bcbdb3-9583-4dea-905e-295debca4c81" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-e6bcbdb3-9583-4dea-905e-295debca4c81" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f39163-cf9c-4d9e-a42b-e886a53f9a95]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:41 devstack sudo[104906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81
Jul 03 13:09:41 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:42 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81" returned: 0 in 1.126s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:43 devstack sudo[104911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81
Jul 03 13:09:43 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:43 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e6bcbdb3-9583-4dea-905e-295debca4c81" returned: 0 in 0.723s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-e6bcbdb3-9583-4dea-905e-295debca4c81" released by "delete_volume" :: held 1.917s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:43 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Created reservations ['885c5f1a-c995-4ef0-afbc-3251f026f34a', '8c889047-441a-488c-9a87-103ebc3d844f', '5b2b35d5-ea86-4015-aceb-d53d37d1cdf8', '4ff8fdd6-4288-429f-b562-c90f1c756d61'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:43 devstack sudo[104914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:09:43 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-714da649-4f8f-4a29-8a7c-6100e8533b50-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-714da649-4f8f-4a29-8a7c-6100e8533b50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-4d10c83c-e864-4d5f-aead-6e1b7f769192" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-4d10c83c-e864-4d5f-aead-6e1b7f769192" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-714da649-4f8f-4a29-8a7c-6100e8533b50" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-714da649-4f8f-4a29-8a7c-6100e8533b50" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Deleting offline snapshot 714da649-4f8f-4a29-8a7c-6100e8533b50 of volume 4d10c83c-e864-4d5f-aead-6e1b7f769192 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:09:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] snapshot_file for this snap is: volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:09:44 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[546a4e1e-650d-40eb-b827-7095954e3819]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:44 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50
Jul 03 13:09:44 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:44 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.071s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:45 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:09:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Deleted volume successfully.
Jul 03 13:09:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74a3c9e9-3f52-46f2-8847-d13807a0e0df tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-e6bcbdb3-9583-4dea-905e-295debca4c81-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:45 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50" returned: 0 in 1.043s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d10c83c-e864-4d5f-aead-6e1b7f769192(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:09:45 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9d6163-ae27-4777-8e5e-03bb981fb242]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:45 devstack sudo[104922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192
Jul 03 13:09:45 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:46 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192" returned: 0 in 0.886s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:46 devstack sudo[104927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50
Jul 03 13:09:46 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:47 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50" returned: 0 in 0.920s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:47 devstack sudo[104932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50
Jul 03 13:09:47 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:47 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192.714da649-4f8f-4a29-8a7c-6100e8533b50" returned: 0 in 0.685s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-714da649-4f8f-4a29-8a7c-6100e8533b50" released by "_delete_snapshot" :: held 3.658s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-4d10c83c-e864-4d5f-aead-6e1b7f769192" released by "delete_snapshot" :: held 3.691s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:47 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Created reservations ['b7b073ef-8655-4a7a-8a5b-0cdd056959fe', '0efad0b7-8bd9-4c7f-932e-e512d91c2568', '97ebc2b7-d93e-4ad3-8d2e-49795ad9910d', 'd47006c7-50cc-4fc2-961b-11fc1b344e20'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Delete snapshot completed successfully.
Jul 03 13:09:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-03e5277f-2e6a-4965-824d-fe1234b08b64 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-714da649-4f8f-4a29-8a7c-6100e8533b50-delete_snapshot" released by "delete_snapshot" :: held 3.886s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-4d10c83c-e864-4d5f-aead-6e1b7f769192-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-4d10c83c-e864-4d5f-aead-6e1b7f769192-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-4d10c83c-e864-4d5f-aead-6e1b7f769192" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-4d10c83c-e864-4d5f-aead-6e1b7f769192" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:48 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebfeda3-074d-49e0-bfdd-3a454ed396ac]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:48 devstack sudo[104935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192
Jul 03 13:09:48 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:49 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192" returned: 0 in 0.897s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:49 devstack sudo[104940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192
Jul 03 13:09:49 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:50 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4d10c83c-e864-4d5f-aead-6e1b7f769192" returned: 0 in 0.782s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-4d10c83c-e864-4d5f-aead-6e1b7f769192" released by "delete_volume" :: held 1.753s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:50 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Created reservations ['48d0a34f-2e86-4002-b954-5a7ad03eb5e8', 'dd54f458-9d00-4111-927d-abe636d52f6e', '74f61550-1893-4a01-bc94-f4202c6f6d23', '3613d0a0-d48f-42d4-8542-af3589d7ec04'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:50 devstack sudo[104943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:09:50 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:51 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.956s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:09:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Deleted volume successfully.
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-df7feb3c-e6b4-4401-b441-d199cc8e633e tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-4d10c83c-e864-4d5f-aead-6e1b7f769192-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Flow 'volume_create_manager' (bb8e210f-2cff-42c7-8d7c-6c56169da05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8d30c6-2f30-4fe1-aa47-e4e2786629f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8d30c6-2f30-4fe1-aa47-e4e2786629f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-676053289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3027ed09-6e25-40a0-bdbb-82337372a9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971ef7981734719b8a3126c3e50b893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:51Z,use_quota=True,user_id='53539d0d443a454f89227041fb0db8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15675941-8059-44e9-8fdf-87c2ff81cf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15675941-8059-44e9-8fdf-87c2ff81cf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabe843c-fa82-46a2-b3e5-e5901a651bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabe843c-fa82-46a2-b3e5-e5901a651bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3027ed09-6e25-40a0-bdbb-82337372a9d5', 'volume_name': 'volume-3027ed09-6e25-40a0-bdbb-82337372a9d5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fd6533-15e2-4bd6-82fe-0725d952db26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fd6533-15e2-4bd6-82fe-0725d952db26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967244a3-0156-4766-b0ed-bd7d0d8b14f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:51 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Volume 3027ed09-6e25-40a0-bdbb-82337372a9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3027ed09-6e25-40a0-bdbb-82337372a9d5', 'volume_size': 1}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-676053289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3027ed09-6e25-40a0-bdbb-82337372a9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971ef7981734719b8a3126c3e50b893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:51Z,use_quota=True,user_id='53539d0d443a454f89227041fb0db8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Creating volume 3027ed09-6e25-40a0-bdbb-82337372a9d5 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:09:51 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:09:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:51 devstack sudo[104950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 1073741824
Jul 03 13:09:51 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:52 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 1073741824" returned: 0 in 1.044s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:52 devstack sudo[104956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5
Jul 03 13:09:52 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:53 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5" returned: 0 in 0.827s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:09:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967244a3-0156-4766-b0ed-bd7d0d8b14f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3027ed09-6e25-40a0-bdbb-82337372a9d5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7aa62c-8644-43ad-9329-2fed68a8e539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Volume volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 (3027ed09-6e25-40a0-bdbb-82337372a9d5): created successfully
Jul 03 13:09:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7aa62c-8644-43ad-9329-2fed68a8e539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Flow 'volume_create_manager' (bb8e210f-2cff-42c7-8d7c-6c56169da05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-75cd2d6f-aaa4-4622-874d-a69adce83b7c tempest-VolumesSnapshotTestJSON-1180596588 None] Created volume successfully.
Jul 03 13:09:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] Creating offline snapshot 0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 of volume 3027ed09-6e25-40a0-bdbb-82337372a9d5 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:09:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[072c88b7-8e87-4e3f-bd6a-beee4eb1f650]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:55 devstack sudo[104959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5
Jul 03 13:09:55 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:55 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5" returned: 0 in 0.935s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:55 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 1G
Jul 03 13:09:55 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:56 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 1G" returned: 0 in 0.984s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:56 devstack sudo[104970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25
Jul 03 13:09:56 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:57 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25" returned: 0 in 0.833s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:57 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 is being set with open permissions: ugo+rw
Jul 03 13:09:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:57 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25
Jul 03 13:09:57 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:09:58 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Flow 'volume_create_manager' (231539cc-12a9-4f19-8db7-c8a6c0da590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e86b93-2de1-482e-a428-7070ea0be6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25" returned: 0 in 0.709s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e86b93-2de1-482e-a428-7070ea0be6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1584574540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b127ef6-9399-494a-8d9e-5974750f1158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9557923d5f9a4883847e782f25f8d315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:58Z,use_quota=True,user_id='7c3338b9a467433bb9598118781e7725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd26898-7249-4951-a512-7e17eff32c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd26898-7249-4951-a512-7e17eff32c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8ea755-1c51-478b-9108-5ae5660aa24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8ea755-1c51-478b-9108-5ae5660aa24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b127ef6-9399-494a-8d9e-5974750f1158', 'volume_name': 'volume-0b127ef6-9399-494a-8d9e-5974750f1158', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98baf840-f9a6-4ce4-b6f9-04c41d0ea651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98baf840-f9a6-4ce4-b6f9-04c41d0ea651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2238da08-df7d-499b-b6c8-5ad65f714a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:58 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Volume 0b127ef6-9399-494a-8d9e-5974750f1158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b127ef6-9399-494a-8d9e-5974750f1158', 'volume_size': 1}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:58 devstack sudo[104979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.info
Jul 03 13:09:58 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Flow 'volume_create_manager' (46d96341-d250-4ba0-96c0-7258dd1814b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9d8028-0d2a-4755-8895-f5f8817f51d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9d8028-0d2a-4755-8895-f5f8817f51d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-222678703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f82acb-b864-44b3-993b-ebe26303da0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9557923d5f9a4883847e782f25f8d315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:59Z,use_quota=True,user_id='7c3338b9a467433bb9598118781e7725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f532a645-e937-4867-9467-1799802d5336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f532a645-e937-4867-9467-1799802d5336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d917cab-565d-4128-a1a8-fb7f9c2c4e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d917cab-565d-4128-a1a8-fb7f9c2c4e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f82acb-b864-44b3-993b-ebe26303da0a', 'volume_name': 'volume-04f82acb-b864-44b3-993b-ebe26303da0a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4ff152-2de1-45ea-a99f-8466cd826223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4ff152-2de1-45ea-a99f-8466cd826223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d104e0-7fed-4820-8ed9-6740f46f5fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:58 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Volume 04f82acb-b864-44b3-993b-ebe26303da0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f82acb-b864-44b3-993b-ebe26303da0a', 'volume_size': 1}
Jul 03 13:09:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:59 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.info" returned: 0 in 0.729s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:59 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.info is being set with open permissions: ugo+rw
Jul 03 13:09:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:59 devstack sudo[104983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.info
Jul 03 13:09:59 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:59 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.info" returned: 0 in 0.736s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.110s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.524s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1584574540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b127ef6-9399-494a-8d9e-5974750f1158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9557923d5f9a4883847e782f25f8d315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:58Z,use_quota=True,user_id='7c3338b9a467433bb9598118781e7725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Creating volume 0b127ef6-9399-494a-8d9e-5974750f1158 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:00 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:00 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158 1073741824
Jul 03 13:10:00 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:00 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e8132a6a-c580-4021-bd6b-b6fead1409a2 tempest-VolumesSnapshotTestJSON-1180596588 None] Create snapshot completed successfully
Jul 03 13:10:00 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158 1073741824" returned: 0 in 0.956s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:01 devstack sudo[104993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158
Jul 03 13:10:01 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:01 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158" returned: 0 in 0.896s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.086s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-222678703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f82acb-b864-44b3-993b-ebe26303da0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9557923d5f9a4883847e782f25f8d315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:59Z,use_quota=True,user_id='7c3338b9a467433bb9598118781e7725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Creating volume 04f82acb-b864-44b3-993b-ebe26303da0a {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:01 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:10:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:02 devstack sudo[105036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a 1073741824
Jul 03 13:10:02 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2238da08-df7d-499b-b6c8-5ad65f714a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b127ef6-9399-494a-8d9e-5974750f1158', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42635887-c57b-471d-8e5b-6969efe00208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:10:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Volume volume-0b127ef6-9399-494a-8d9e-5974750f1158 (0b127ef6-9399-494a-8d9e-5974750f1158): created successfully
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42635887-c57b-471d-8e5b-6969efe00208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Flow 'volume_create_manager' (231539cc-12a9-4f19-8db7-c8a6c0da590a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Flow 'volume_create_manager' (bcdfaff4-4611-43d6-86ab-2663925056c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217fa780-aeff-4343-b222-3e8c4baeb085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-51aedba3-d17b-4fd6-be93-25679ff00f3a tempest-TestServerVolumeAttachmentScenario-1922688686 None] Created volume successfully.
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217fa780-aeff-4343-b222-3e8c4baeb085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-592982324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e350d6-5292-4949-8d1a-10aadfe8ef9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971ef7981734719b8a3126c3e50b893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:02Z,use_quota=True,user_id='53539d0d443a454f89227041fb0db8bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b899813-af8d-40c0-8333-9a8f0bb73fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b899813-af8d-40c0-8333-9a8f0bb73fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5643cd-7ff0-47fd-b723-69f747a06278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5643cd-7ff0-47fd-b723-69f747a06278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13e350d6-5292-4949-8d1a-10aadfe8ef9e', 'volume_name': 'volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e', 'volume_size': 1, 'snapshot_id': '0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc91f18b-c754-4c77-af29-218acbab930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc91f18b-c754-4c77-af29-218acbab930e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a32bb37-5790-4bcb-8108-60f58000b911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume 13e350d6-5292-4949-8d1a-10aadfe8ef9e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e', 'volume_size': 1, 'snapshot_id': '0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25'}
Jul 03 13:10:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:03 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a 1073741824" returned: 0 in 1.216s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:03 devstack sudo[105045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a
Jul 03 13:10:03 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:04 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a" returned: 0 in 0.796s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.769s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25-13e350d6-5292-4949-8d1a-10aadfe8ef9e" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d104e0-7fed-4820-8ed9-6740f46f5fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f82acb-b864-44b3-993b-ebe26303da0a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4b5d2a-da28-4940-8ff8-06af03b9f723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25-13e350d6-5292-4949-8d1a-10aadfe8ef9e" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Creating volume 13e350d6-5292-4949-8d1a-10aadfe8ef9e from snapshot 0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-13e350d6-5292-4949-8d1a-10aadfe8ef9e" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:04 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Volume volume-04f82acb-b864-44b3-993b-ebe26303da0a (04f82acb-b864-44b3-993b-ebe26303da0a): created successfully
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4b5d2a-da28-4940-8ff8-06af03b9f723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Flow 'volume_create_manager' (46d96341-d250-4ba0-96c0-7258dd1814b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-13e350d6-5292-4949-8d1a-10aadfe8ef9e" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] snapshot: 0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25, volume: 13e350d6-5292-4949-8d1a-10aadfe8ef9e,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:10:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-659daa79-59b2-4b59-a88a-adfa654ed02b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Created volume successfully.
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[12638ebf-08d5-4cd3-bb64-f31d243ccb04]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:04 devstack sudo[105048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25
Jul 03 13:10:04 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:04 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25" returned: 0 in 0.826s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3027ed09-6e25-40a0-bdbb-82337372a9d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:10:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a211a33-1f94-486f-98a6-02ab7b95f866]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:05 devstack sudo[105060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:10:05 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:05 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5
Jul 03 13:10:05 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:05 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.706s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:10:05 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5" returned: 0 in 0.863s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 13:10:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:05 devstack sudo[105067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e
Jul 03 13:10:05 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:11 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e" returned: 0 in 5.996s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:11 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[043d877a-0a32-4210-8c80-d7511c1a96ab]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:12 devstack sudo[105101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5
Jul 03 13:10:12 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:13 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5" returned: 0 in 1.118s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:13 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:10:13 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Converted 1024.00 MB image at 170.75 MB/s
Jul 03 13:10:13 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e is being set with open permissions: ugo+rw
Jul 03 13:10:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:13 devstack sudo[105107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e
Jul 03 13:10:13 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:13 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e" returned: 0 in 0.715s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-13e350d6-5292-4949-8d1a-10aadfe8ef9e" released by "_copy_volume_from_snapshot" :: held 9.632s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25-13e350d6-5292-4949-8d1a-10aadfe8ef9e" released by "_create_volume_from_snapshot" :: held 9.679s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.717s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a32bb37-5790-4bcb-8108-60f58000b911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e', 'volume_size': 1, 'snapshot_id': '0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979e0d93-eb5c-4240-980f-9ea2598e3d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:13 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Volume volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e (13e350d6-5292-4949-8d1a-10aadfe8ef9e): created successfully
Jul 03 13:10:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979e0d93-eb5c-4240-980f-9ea2598e3d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Flow 'volume_create_manager' (bcdfaff4-4611-43d6-86ab-2663925056c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-87ab1ad5-71ab-4b52-8b90-c4eca39e73f7 tempest-VolumesSnapshotTestJSON-1180596588 None] Created volume successfully.
Jul 03 13:10:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-13e350d6-5292-4949-8d1a-10aadfe8ef9e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-13e350d6-5292-4949-8d1a-10aadfe8ef9e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-13e350d6-5292-4949-8d1a-10aadfe8ef9e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-13e350d6-5292-4949-8d1a-10aadfe8ef9e" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bf6f22-7fed-4b08-b910-fbda59c56f39]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:14 devstack sudo[105110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e
Jul 03 13:10:14 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:15 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e" returned: 0 in 0.935s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:15 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e
Jul 03 13:10:15 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:16 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-13e350d6-5292-4949-8d1a-10aadfe8ef9e" returned: 0 in 0.829s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-13e350d6-5292-4949-8d1a-10aadfe8ef9e" released by "delete_volume" :: held 1.819s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Created reservations ['29034fd9-cc39-4c93-9534-4b47692e6404', '9429e20f-bee4-43f4-b135-23642cc1bda7', 'd525caf0-13ce-43d1-ab86-75d6d35d3f30', 'a98b07c5-0b15-4446-861c-5768d78afed7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:16 devstack sudo[105121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:10:16 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-3027ed09-6e25-40a0-bdbb-82337372a9d5" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-3027ed09-6e25-40a0-bdbb-82337372a9d5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Deleting offline snapshot 0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 of volume 3027ed09-6e25-40a0-bdbb-82337372a9d5 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] snapshot_file for this snap is: volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[027bdea2-2557-449a-b317-3a4378ba7f59]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:16 devstack sudo[105123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25
Jul 03 13:10:16 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:17 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.791s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:17 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:10:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Deleted volume successfully.
Jul 03 13:10:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48a58f10-b202-46e4-8746-996e1e7e201d tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-13e350d6-5292-4949-8d1a-10aadfe8ef9e-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:17 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25" returned: 0 in 1.064s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3027ed09-6e25-40a0-bdbb-82337372a9d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:10:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[de307647-7e31-4a37-a234-b959f40baa86]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:17 devstack sudo[105177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5
Jul 03 13:10:17 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:18 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5" returned: 0 in 1.152s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:18 devstack sudo[105201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25
Jul 03 13:10:18 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:19 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25" returned: 0 in 0.887s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:19 devstack sudo[105207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25
Jul 03 13:10:19 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:20 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5.0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25" returned: 0 in 0.694s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25" released by "_delete_snapshot" :: held 3.947s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-3027ed09-6e25-40a0-bdbb-82337372a9d5" released by "delete_snapshot" :: held 3.976s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Created reservations ['a9a37939-735b-471d-8911-529c85446813', 'be26c4bf-d1da-4a3c-96cc-dd40cd9e5b82', '32929708-645a-4b17-97e7-f5aab56afe23', 'f54f4be3-792a-4503-b3b8-d9033e64cee0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Delete snapshot completed successfully.
Jul 03 13:10:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2451a6f8-54d4-438c-a18f-a67fc17548ed tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-0f971b6b-a4b5-4cc9-a7d4-2e9332a97f25-delete_snapshot" released by "delete_snapshot" :: held 4.137s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-3027ed09-6e25-40a0-bdbb-82337372a9d5-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-3027ed09-6e25-40a0-bdbb-82337372a9d5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-3027ed09-6e25-40a0-bdbb-82337372a9d5" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-3027ed09-6e25-40a0-bdbb-82337372a9d5" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:21 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb22511f-bd80-477d-a639-74208bfda359]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:21 devstack sudo[105211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5
Jul 03 13:10:21 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:22 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5" returned: 0 in 0.994s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:22 devstack sudo[105216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5
Jul 03 13:10:22 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:22 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-3027ed09-6e25-40a0-bdbb-82337372a9d5" returned: 0 in 0.764s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-3027ed09-6e25-40a0-bdbb-82337372a9d5" released by "delete_volume" :: held 1.863s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:22 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Created reservations ['b49842ce-3802-4cbb-9b71-89dfb347e112', '4eef0b96-99e2-482d-bf22-b96afb0a636a', '1f121484-1633-4f1c-a02f-d8a8814d5ac9', '05e2d99b-f33c-4299-9fe3-85f7dbcbbc51'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:23 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:10:23 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-75a5265c-de88-498c-b589-cc6f440f68cc-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-75a5265c-de88-498c-b589-cc6f440f68cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=49,cinder:UPDATE=67,cinder:INSERT=18,cinder:DELETE=3 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=53,cinder:UPDATE=57,cinder:DELETE=8,cinder:INSERT=12 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "cinder-quobyte-75a5265c-de88-498c-b589-cc6f440f68cc" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-75a5265c-de88-498c-b589-cc6f440f68cc" acquired by "delete_volume" :: waited 0.054s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b223c185-2807-47a1-8479-1f67e7d9cf3d]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:23 devstack sudo[105223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc
Jul 03 13:10:23 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:23 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.884s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:10:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Deleted volume successfully.
Jul 03 13:10:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5d127938-9efe-4957-a461-0946ac1dadf7 tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-3027ed09-6e25-40a0-bdbb-82337372a9d5-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:24 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc" returned: 0 in 0.959s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:24 devstack sudo[105229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc
Jul 03 13:10:24 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:25 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-75a5265c-de88-498c-b589-cc6f440f68cc" returned: 0 in 0.743s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-quobyte-75a5265c-de88-498c-b589-cc6f440f68cc" released by "delete_volume" :: held 1.789s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:25 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Created reservations ['2057f0a8-1265-4560-9035-09d8113d5622', '55cc5de3-b12d-462b-8836-f6efeb067338', '8789863c-eac1-422e-8b78-44b4b36b84e1', 'f13c098f-81a7-4dd2-a0f4-2a0474cb68a1'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:25 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:10:25 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:26 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.790s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:26 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:10:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Deleted volume successfully.
Jul 03 13:10:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9876d0fa-9246-4d61-86fe-9b5f5e39040a tempest-VolumesSnapshotTestJSON-1180596588 None] Lock "cinder-75a5265c-de88-498c-b589-cc6f440f68cc-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:45 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=7,cinder:DELETE=1,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:10:45 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:10:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-57e2fcb6-50a1-4574-a84b-c563bec8be20 req-3e71e3a7-dbbb-4be9-8c8a-16000fb9530b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-57e2fcb6-50a1-4574-a84b-c563bec8be20 req-3e71e3a7-dbbb-4be9-8c8a-16000fb9530b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:46 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60c783f-2db0-421b-ac4a-6937bef1acb3]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-57e2fcb6-50a1-4574-a84b-c563bec8be20 req-3e71e3a7-dbbb-4be9-8c8a-16000fb9530b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:46 devstack sudo[105269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158
Jul 03 13:10:46 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:47 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-57e2fcb6-50a1-4574-a84b-c563bec8be20 req-3e71e3a7-dbbb-4be9-8c8a-16000fb9530b tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158" returned: 0 in 0.816s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-57e2fcb6-50a1-4574-a84b-c563bec8be20 req-3e71e3a7-dbbb-4be9-8c8a-16000fb9530b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.852s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-57e2fcb6-50a1-4574-a84b-c563bec8be20 req-3e71e3a7-dbbb-4be9-8c8a-16000fb9530b tempest-TestServerVolumeAttachmentScenario-1922688686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-0b127ef6-9399-494a-8d9e-5974750f1158', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'edef54d0-1e87-4e16-bc9f-ff4b35e2ae4b', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:10:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-57e2fcb6-50a1-4574-a84b-c563bec8be20 req-3e71e3a7-dbbb-4be9-8c8a-16000fb9530b tempest-TestServerVolumeAttachmentScenario-1922688686 None] attachment_update completed successfully.
Jul 03 13:10:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-8b25f335-0fbb-44a9-a4ac-fbae11e71a28 req-7ddbc8f4-8710-4627-8ca2-a9cbc66914a2 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-8b25f335-0fbb-44a9-a4ac-fbae11e71a28 req-7ddbc8f4-8710-4627-8ca2-a9cbc66914a2 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:56 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee164a52-b262-45ac-90a8-1643764d2048]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8b25f335-0fbb-44a9-a4ac-fbae11e71a28 req-7ddbc8f4-8710-4627-8ca2-a9cbc66914a2 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:57 devstack sudo[105678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a
Jul 03 13:10:57 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:57 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:10:57 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-8b25f335-0fbb-44a9-a4ac-fbae11e71a28 req-7ddbc8f4-8710-4627-8ca2-a9cbc66914a2 tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a" returned: 0 in 0.949s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-8b25f335-0fbb-44a9-a4ac-fbae11e71a28 req-7ddbc8f4-8710-4627-8ca2-a9cbc66914a2 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.973s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-8b25f335-0fbb-44a9-a4ac-fbae11e71a28 req-7ddbc8f4-8710-4627-8ca2-a9cbc66914a2 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-04f82acb-b864-44b3-993b-ebe26303da0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4af0c249-ef5c-4ea4-89c6-c2347f085f25', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:10:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-8b25f335-0fbb-44a9-a4ac-fbae11e71a28 req-7ddbc8f4-8710-4627-8ca2-a9cbc66914a2 tempest-TestServerVolumeAttachmentScenario-1922688686 None] attachment_update completed successfully.
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Flow 'volume_create_manager' (b32d5c48-7aab-4f88-b2b2-8292925496aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e38def9-7e7f-4a02-a408-1685ace5747f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e38def9-7e7f-4a02-a408-1685ace5747f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-846551141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6858c60a-52f7-4618-9424-08e006f926ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48525ebadf014442b0b0e68b144c806d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:59Z,use_quota=True,user_id='04be8cb63dd944a98a0629915b3a9e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14de55b7-72b8-4eee-b126-f598ec739878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14de55b7-72b8-4eee-b126-f598ec739878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed41fabb-6e56-4efd-aa27-613cbfbf8655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed41fabb-6e56-4efd-aa27-613cbfbf8655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6858c60a-52f7-4618-9424-08e006f926ca', 'volume_name': 'volume-6858c60a-52f7-4618-9424-08e006f926ca', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b61ac1d0>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497e02cf-c0df-4570-950f-9f0df77a925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497e02cf-c0df-4570-950f-9f0df77a925e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6940cb3-7b84-47fe-bd43-6f1220491df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:59 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Volume 6858c60a-52f7-4618-9424-08e006f926ca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6858c60a-52f7-4618-9424-08e006f926ca', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b61ac1d0>}
Jul 03 13:10:59 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Trying to clone 6858c60a-52f7-4618-9424-08e006f926ca from image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jul 03 13:11:00 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jul 03 13:11:00 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 13:11:00 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37a5844-8263-47d6-be80-6bcab8a867d5]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:00 devstack sudo[105688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD
Jul 03 13:11:00 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:01 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD" returned: 0 in 0.871s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Temporary image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 is fetched for user 04be8cb63dd944a98a0629915b3a9e46. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c77d3b-5fa2-40f7-85cf-24ad5e961238]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:01 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD
Jul 03 13:11:01 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:01 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD" returned: 0 in 0.756s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-846551141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6858c60a-52f7-4618-9424-08e006f926ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48525ebadf014442b0b0e68b144c806d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:59Z,use_quota=True,user_id='04be8cb63dd944a98a0629915b3a9e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Creating volume 6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:11:01 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:11:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:01 devstack sudo[105701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca 1073741824
Jul 03 13:11:01 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:02 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca 1073741824" returned: 0 in 0.898s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:02 devstack sudo[105743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca
Jul 03 13:11:02 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-9a92b72d-ed12-4db9-9a86-95ec5d75b4c0 req-f960780c-832d-409d-be04-94c3eea35fd3 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Terminate volume connection completed successfully.
Jul 03 13:11:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-9a92b72d-ed12-4db9-9a86-95ec5d75b4c0 req-f960780c-832d-409d-be04-94c3eea35fd3 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Deleting attachment 4af0c249-ef5c-4ea4-89c6-c2347f085f25. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:11:03 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca" returned: 0 in 0.752s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:11:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:03 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Attempting download of 8af9b126-5566-44ac-8948-4fb0a1be3fd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}])) to volume 6858c60a-52f7-4618-9424-08e006f926ca. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jul 03 13:11:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f3b3b6-b29c-410d-a50b-02224d48fd08]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_obl53zvk {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:03 devstack sudo[105748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_obl53zvk
Jul 03 13:11:03 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:04 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_obl53zvk" returned: 0 in 0.794s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_obl53zvk {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:04 devstack sudo[105752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_obl53zvk
Jul 03 13:11:04 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:05 devstack sudo[105757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:11:05 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:05 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_obl53zvk" returned: 1 in 0.777s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8af9b126-5566-44ac-8948-4fb0a1be3fd3_obl53zvk' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c90fbe-3684-4fab-a2d8-ce2acba5e80e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:05 devstack sudo[105764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD
Jul 03 13:11:05 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:05 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.744s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:11:06 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD" returned: 0 in 0.844s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:06 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] 8af9b126-5566-44ac-8948-4fb0a1be3fd3 was qcow2, converting to raw {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jul 03 13:11:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:06 devstack sudo[105770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca
Jul 03 13:11:06 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-0ff093b4-b8ca-4426-bea0-ba2d2b4993b4 req-cb272f83-c038-408e-957b-4b64001ada04 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Terminate volume connection completed successfully.
Jul 03 13:11:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-0ff093b4-b8ca-4426-bea0-ba2d2b4993b4 req-cb272f83-c038-408e-957b-4b64001ada04 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Deleting attachment edef54d0-1e87-4e16-bc9f-ff4b35e2ae4b. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:11:08 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca" returned: 0 in 2.057s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:08 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8af9b126-5566-44ac-8948-4fb0a1be3fd3_fsav9w62devstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:11:08 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Converted 112.00 MB image at 54.41 MB/s
Jul 03 13:11:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:08 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca 1G
Jul 03 13:11:08 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:08 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca 1G" returned: 0 in 0.676s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b9618e-5929-466d-8999-499f756b9677]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:09 devstack sudo[105811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca
Jul 03 13:11:09 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:09 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca" returned: 0 in 0.800s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:09 devstack sudo[105815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca
Jul 03 13:11:09 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:10 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca" returned: 1 in 0.794s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:11:10 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Downloaded image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}])) to volume 6858c60a-52f7-4618-9424-08e006f926ca successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jul 03 13:11:10 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Temporary image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 for user 04be8cb63dd944a98a0629915b3a9e46 is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jul 03 13:11:10 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Marking volume 6858c60a-52f7-4618-9424-08e006f926ca as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jul 03 13:11:10 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Copying metadata from image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 to 6858c60a-52f7-4618-9424-08e006f926ca. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:11:10 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Creating volume glance metadata for volume 6858c60a-52f7-4618-9424-08e006f926ca backed by image 8af9b126-5566-44ac-8948-4fb0a1be3fd3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:11:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6940cb3-7b84-47fe-bd43-6f1220491df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6858c60a-52f7-4618-9424-08e006f926ca', 'volume_size': 1, 'image_id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd41fbb1fa75342c0b1b52034786d05ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8af9b126-5566-44ac-8948-4fb0a1be3fd3', 'created_at': datetime.datetime(2026, 7, 3, 10, 40, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 40, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8af9b126-5566-44ac-8948-4fb0a1be3fd3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b61ac1d0>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffbbf64-353c-4ea7-81b2-a48c017b157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Volume volume-6858c60a-52f7-4618-9424-08e006f926ca (6858c60a-52f7-4618-9424-08e006f926ca): created successfully
Jul 03 13:11:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffbbf64-353c-4ea7-81b2-a48c017b157d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Flow 'volume_create_manager' (b32d5c48-7aab-4f88-b2b2-8292925496aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-55a657d8-0de3-4009-9c65-e2ed3eaf67b8 tempest-TestShelveInstance-1128269345 None] Created volume successfully.
Jul 03 13:11:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-b1fa06ce-9651-4c0b-a38e-91fa96ada6da req-80c94fb2-cd46-49fc-a165-a7332deda03b tempest-TestShelveInstance-1128269345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-b1fa06ce-9651-4c0b-a38e-91fa96ada6da req-80c94fb2-cd46-49fc-a165-a7332deda03b tempest-TestShelveInstance-1128269345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ed40ba-74b0-4472-86e4-77f7f4bb1969]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-b1fa06ce-9651-4c0b-a38e-91fa96ada6da req-80c94fb2-cd46-49fc-a165-a7332deda03b tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:19 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca
Jul 03 13:11:19 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:19 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-b1fa06ce-9651-4c0b-a38e-91fa96ada6da req-80c94fb2-cd46-49fc-a165-a7332deda03b tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca" returned: 0 in 1.040s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-b1fa06ce-9651-4c0b-a38e-91fa96ada6da req-80c94fb2-cd46-49fc-a165-a7332deda03b tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:20 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca
Jul 03 13:11:20 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "cinder-04f82acb-b864-44b3-993b-ebe26303da0a-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "cinder-04f82acb-b864-44b3-993b-ebe26303da0a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "cinder-quobyte-04f82acb-b864-44b3-993b-ebe26303da0a" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "cinder-quobyte-04f82acb-b864-44b3-993b-ebe26303da0a" acquired by "delete_volume" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[162dd894-0e9d-4704-ad53-c253f294986b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:20 devstack sudo[105880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a
Jul 03 13:11:20 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:20 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-b1fa06ce-9651-4c0b-a38e-91fa96ada6da req-80c94fb2-cd46-49fc-a165-a7332deda03b tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca" returned: 1 in 0.858s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-b1fa06ce-9651-4c0b-a38e-91fa96ada6da req-80c94fb2-cd46-49fc-a165-a7332deda03b tempest-TestShelveInstance-1128269345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:11:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-b1fa06ce-9651-4c0b-a38e-91fa96ada6da req-80c94fb2-cd46-49fc-a165-a7332deda03b tempest-TestShelveInstance-1128269345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.949s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-b1fa06ce-9651-4c0b-a38e-91fa96ada6da req-80c94fb2-cd46-49fc-a165-a7332deda03b tempest-TestShelveInstance-1128269345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-6858c60a-52f7-4618-9424-08e006f926ca', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f51e00a1-edee-4542-b589-1bad774dff88', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:11:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-b1fa06ce-9651-4c0b-a38e-91fa96ada6da req-80c94fb2-cd46-49fc-a165-a7332deda03b tempest-TestShelveInstance-1128269345 None] attachment_update completed successfully.
Jul 03 13:11:21 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a" returned: 0 in 0.973s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:21 devstack sudo[105890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a
Jul 03 13:11:21 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:22 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-04f82acb-b864-44b3-993b-ebe26303da0a" returned: 0 in 0.767s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "cinder-quobyte-04f82acb-b864-44b3-993b-ebe26303da0a" released by "delete_volume" :: held 1.788s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Created reservations ['15237821-5b94-46c9-89f8-cd3fac199a53', 'f607891d-a73d-4a19-94d0-efe9440141e7', 'cbe8ef60-a43e-4b85-ad3b-247397f9d998', '1be29e52-7898-4be8-a3f8-00d77fdc7b45'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:22 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:11:22 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "cinder-0b127ef6-9399-494a-8d9e-5974750f1158-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "cinder-0b127ef6-9399-494a-8d9e-5974750f1158-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "cinder-quobyte-0b127ef6-9399-494a-8d9e-5974750f1158" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "cinder-quobyte-0b127ef6-9399-494a-8d9e-5974750f1158" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f8a23a-365b-43a0-8792-b054896aacfa]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:23 devstack sudo[105895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158
Jul 03 13:11:23 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:23 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.810s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:23 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:11:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Deleted volume successfully.
Jul 03 13:11:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b40c87cc-426b-4eb2-99a5-49559c6b612c tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "cinder-04f82acb-b864-44b3-993b-ebe26303da0a-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:23 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158" returned: 0 in 1.011s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:23 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158
Jul 03 13:11:23 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:24 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0b127ef6-9399-494a-8d9e-5974750f1158" returned: 0 in 0.830s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "cinder-quobyte-0b127ef6-9399-494a-8d9e-5974750f1158" released by "delete_volume" :: held 1.895s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:24 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Created reservations ['2a85230e-4a83-4f18-8db1-d5f61e506082', 'a6c56669-3423-4ffa-852b-6e4b1d8865aa', 'b15fef57-117c-47c5-8a3b-2197ca43b758', '40565af3-2427-4db7-80c5-e8921428ab70'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:25 devstack sudo[105975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:11:25 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:25 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.784s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:25 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:11:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Deleted volume successfully.
Jul 03 13:11:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0144ea3e-f3a0-4b86-a5e7-3d6927bbb778 tempest-TestServerVolumeAttachmentScenario-1922688686 None] Lock "cinder-0b127ef6-9399-494a-8d9e-5974750f1158-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:34 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=39,cinder:UPDATE=30,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:11:35 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=32,cinder:UPDATE=18,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:12:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-31626e82-b067-450d-a4c8-9600b4ca4c06 req-15dbf360-6c82-43ff-a1f0-7d90d464545d tempest-TestShelveInstance-1128269345 None] Terminate volume connection completed successfully.
Jul 03 13:12:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-31626e82-b067-450d-a4c8-9600b4ca4c06 req-15dbf360-6c82-43ff-a1f0-7d90d464545d tempest-TestShelveInstance-1128269345 None] Deleting attachment f51e00a1-edee-4542-b589-1bad774dff88. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:12:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:12:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:05 devstack sudo[106560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:12:05 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:05 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.640s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:12:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d6a586c9-72ae-4f4f-8776-60aef66b5495 req-e1acae7b-07d1-4d09-9c43-1192455dd94e tempest-TestShelveInstance-1128269345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d6a586c9-72ae-4f4f-8776-60aef66b5495 req-e1acae7b-07d1-4d09-9c43-1192455dd94e tempest-TestShelveInstance-1128269345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:06 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d61063-0794-4f2a-b2b2-38a7e8b8dfc8]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-d6a586c9-72ae-4f4f-8776-60aef66b5495 req-e1acae7b-07d1-4d09-9c43-1192455dd94e tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:07 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca
Jul 03 13:12:07 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:07 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-d6a586c9-72ae-4f4f-8776-60aef66b5495 req-e1acae7b-07d1-4d09-9c43-1192455dd94e tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca" returned: 0 in 0.769s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-d6a586c9-72ae-4f4f-8776-60aef66b5495 req-e1acae7b-07d1-4d09-9c43-1192455dd94e tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:07 devstack sudo[106581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca
Jul 03 13:12:07 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:08 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-d6a586c9-72ae-4f4f-8776-60aef66b5495 req-e1acae7b-07d1-4d09-9c43-1192455dd94e tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca" returned: 1 in 0.734s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-d6a586c9-72ae-4f4f-8776-60aef66b5495 req-e1acae7b-07d1-4d09-9c43-1192455dd94e tempest-TestShelveInstance-1128269345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:12:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-d6a586c9-72ae-4f4f-8776-60aef66b5495 req-e1acae7b-07d1-4d09-9c43-1192455dd94e tempest-TestShelveInstance-1128269345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.540s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:08 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-d6a586c9-72ae-4f4f-8776-60aef66b5495 req-e1acae7b-07d1-4d09-9c43-1192455dd94e tempest-TestShelveInstance-1128269345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586', 'name': 'volume-6858c60a-52f7-4618-9424-08e006f926ca', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a8111b4-ce17-4179-a7f3-ff9268f1a5b2', 'enforce_multipath': True} {{(pid=86763) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:12:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-d6a586c9-72ae-4f4f-8776-60aef66b5495 req-e1acae7b-07d1-4d09-9c43-1192455dd94e tempest-TestShelveInstance-1128269345 None] attachment_update completed successfully.
Jul 03 13:12:18 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:12:18 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:12:45 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:12:45 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:13:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-589d7222-ab88-414b-ac49-43a13647370d req-dd1e50c4-6a60-46e7-9a44-6280d8b3f08b tempest-TestShelveInstance-1128269345 None] Terminate volume connection completed successfully.
Jul 03 13:13:02 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [req-589d7222-ab88-414b-ac49-43a13647370d req-dd1e50c4-6a60-46e7-9a44-6280d8b3f08b tempest-TestShelveInstance-1128269345 None] Deleting attachment 8a8111b4-ce17-4179-a7f3-ff9268f1a5b2. {{(pid=86763) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:13:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Acquiring lock "cinder-6858c60a-52f7-4618-9424-08e006f926ca-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Lock "cinder-6858c60a-52f7-4618-9424-08e006f926ca-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Acquiring lock "cinder-quobyte-6858c60a-52f7-4618-9424-08e006f926ca" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Lock "cinder-quobyte-6858c60a-52f7-4618-9424-08e006f926ca" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebeee68-1fa4-4bdf-b42f-3b73b5e3e480]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:03 devstack sudo[107165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca
Jul 03 13:13:03 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:03 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca" returned: 0 in 0.792s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:03 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca
Jul 03 13:13:03 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:04 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca" returned: 1 in 0.750s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:13:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:04 devstack sudo[107176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca
Jul 03 13:13:04 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:05 devstack sudo[107178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:13:05 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:05 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6858c60a-52f7-4618-9424-08e006f926ca" returned: 0 in 0.637s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Lock "cinder-quobyte-6858c60a-52f7-4618-9424-08e006f926ca" released by "delete_volume" :: held 2.271s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG cinder.quota [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Created reservations ['fe3e85ab-993e-41d6-8049-18e81144b9d4', '897989ec-8391-4040-b5d1-ced883ea0875', 'b1a19559-7523-4e97-ad13-3ce10ee2d963', '968fb447-7963-45c8-a35d-2c6f39fbf16a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:05 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:13:05 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:05 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.688s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:13:06 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.732s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:06 devstack cinder-volume[86763]: DEBUG cinder.manager [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:13:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Deleted volume successfully.
Jul 03 13:13:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [req-589d7222-ab88-414b-ac49-43a13647370d req-58649c8b-c287-49da-a03b-ddbd5efaa211 tempest-TestShelveInstance-1128269345 None] Lock "cinder-6858c60a-52f7-4618-9424-08e006f926ca-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:15 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:13:16 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Flow 'volume_create_manager' (0295035f-3267-46c8-b0e1-c1382e54d5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad184fef-8535-4908-af38-bee1e6b7cb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad184fef-8535-4908-af38-bee1e6b7cb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-475147039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e783d9-6aa0-41f0-807d-083b46d112e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5470db7dacff488f87ed86dc051ae3ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:17Z,use_quota=True,user_id='cef96de4dc7b4af49315b07f28629cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c469b2-7eea-4ebd-98f3-eeb3487d2baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c469b2-7eea-4ebd-98f3-eeb3487d2baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2600ce-7cc3-4675-bc75-169f068d2b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2600ce-7cc3-4675-bc75-169f068d2b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e783d9-6aa0-41f0-807d-083b46d112e0', 'volume_name': 'volume-64e783d9-6aa0-41f0-807d-083b46d112e0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52da05d-7d05-4e30-9e5d-416068f2ad8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52da05d-7d05-4e30-9e5d-416068f2ad8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e7dc8f-08f3-453b-93cf-fd7608df0de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Volume 64e783d9-6aa0-41f0-807d-083b46d112e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e783d9-6aa0-41f0-807d-083b46d112e0', 'volume_size': 1}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-475147039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e783d9-6aa0-41f0-807d-083b46d112e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5470db7dacff488f87ed86dc051ae3ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:17Z,use_quota=True,user_id='cef96de4dc7b4af49315b07f28629cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Creating volume 64e783d9-6aa0-41f0-807d-083b46d112e0 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:17 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:17 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0 1073741824
Jul 03 13:13:17 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Flow 'volume_create_manager' (c6cba61a-19b8-4262-a39e-e799c5ec5644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b961466c-3439-4eef-b4d9-c9031f273a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b961466c-3439-4eef-b4d9-c9031f273a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154763567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccda5a97-e26b-4193-974c-3f874de84003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5470db7dacff488f87ed86dc051ae3ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:17Z,use_quota=True,user_id='cef96de4dc7b4af49315b07f28629cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb19173-4fc5-4902-b562-26abae8ba7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb19173-4fc5-4902-b562-26abae8ba7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb984c3-81dc-4a6e-990c-cd9a9e5b279d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb984c3-81dc-4a6e-990c-cd9a9e5b279d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccda5a97-e26b-4193-974c-3f874de84003', 'volume_name': 'volume-ccda5a97-e26b-4193-974c-3f874de84003', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d98baf4-4c5b-4d76-8963-700900643e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d98baf4-4c5b-4d76-8963-700900643e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c478c84-226d-4e9a-819e-2546cc39af8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Volume ccda5a97-e26b-4193-974c-3f874de84003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccda5a97-e26b-4193-974c-3f874de84003', 'volume_size': 1}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Flow 'volume_create_manager' (e2dbc064-44df-4bd5-ae30-38774c8e4235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d65c89-33a9-40ed-a962-2c691081b0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d65c89-33a9-40ed-a962-2c691081b0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-429949673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9483d10-0cd6-4368-a19c-494694c1be9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5470db7dacff488f87ed86dc051ae3ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:18Z,use_quota=True,user_id='cef96de4dc7b4af49315b07f28629cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f5e04c-cf7e-4ff0-b9d9-33b4c9bdbdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f5e04c-cf7e-4ff0-b9d9-33b4c9bdbdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962eccb6-ed19-4078-b1a6-1e2d23dd96a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962eccb6-ed19-4078-b1a6-1e2d23dd96a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9483d10-0cd6-4368-a19c-494694c1be9e', 'volume_name': 'volume-c9483d10-0cd6-4368-a19c-494694c1be9e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7bec3d-02df-44b6-b611-117e73fd2f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:17 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7bec3d-02df-44b6-b611-117e73fd2f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce868cea-e139-4620-b05e-897d222e0e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Volume c9483d10-0cd6-4368-a19c-494694c1be9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9483d10-0cd6-4368-a19c-494694c1be9e', 'volume_size': 1}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:18 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0 1073741824" returned: 0 in 0.977s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:18 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0
Jul 03 13:13:18 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Flow 'volume_create_manager' (8ae1c805-af78-4158-bc4a-651492c6040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588a1800-7949-4d2f-af14-3ea73c87cf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588a1800-7949-4d2f-af14-3ea73c87cf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1710133830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefe6f58-3f32-4b2f-b1bd-df169ad2822e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5470db7dacff488f87ed86dc051ae3ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:18Z,use_quota=True,user_id='cef96de4dc7b4af49315b07f28629cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927cd129-fba8-41da-b5c4-c79dfd481b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927cd129-fba8-41da-b5c4-c79dfd481b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447cde2e-428a-441f-87b2-3b1734e3dd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447cde2e-428a-441f-87b2-3b1734e3dd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eefe6f58-3f32-4b2f-b1bd-df169ad2822e', 'volume_name': 'volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e88f309-efbf-4d18-b8af-86245909d7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e88f309-efbf-4d18-b8af-86245909d7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8ba1c4-4ad3-4222-b108-fae812df673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Volume eefe6f58-3f32-4b2f-b1bd-df169ad2822e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e', 'volume_size': 1}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Flow 'volume_create_manager' (a3434df4-8b5f-4d6e-aa35-eb15a6c46634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984afff5-822c-43c2-a8dd-ff1de1f2b6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984afff5-822c-43c2-a8dd-ff1de1f2b6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1490547996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5109f6e1-3e34-43a1-abb9-8981c8e74415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5470db7dacff488f87ed86dc051ae3ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:19Z,use_quota=True,user_id='cef96de4dc7b4af49315b07f28629cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9ab0be-43fa-4054-b7fc-2a1fd1d0163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9ab0be-43fa-4054-b7fc-2a1fd1d0163b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f2aa40-5e38-4e34-b3f4-1156b47604f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f2aa40-5e38-4e34-b3f4-1156b47604f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5109f6e1-3e34-43a1-abb9-8981c8e74415', 'volume_name': 'volume-5109f6e1-3e34-43a1-abb9-8981c8e74415', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ef0f9e-39b9-4e97-bfc7-12f481640f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ef0f9e-39b9-4e97-bfc7-12f481640f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b931e6e8-9ffb-423b-bc8b-d6cd993dc838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Volume 5109f6e1-3e34-43a1-abb9-8981c8e74415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5109f6e1-3e34-43a1-abb9-8981c8e74415', 'volume_size': 1}
Jul 03 13:13:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:18 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0" returned: 0 in 0.729s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.373s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154763567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccda5a97-e26b-4193-974c-3f874de84003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5470db7dacff488f87ed86dc051ae3ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:17Z,use_quota=True,user_id='cef96de4dc7b4af49315b07f28629cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Creating volume ccda5a97-e26b-4193-974c-3f874de84003 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:19 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e7dc8f-08f3-453b-93cf-fd7608df0de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e783d9-6aa0-41f0-807d-083b46d112e0', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:19 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003 1073741824
Jul 03 13:13:19 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb01679a-147b-4bcd-a7b8-a95522caf4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:19 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Volume volume-64e783d9-6aa0-41f0-807d-083b46d112e0 (64e783d9-6aa0-41f0-807d-083b46d112e0): created successfully
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb01679a-147b-4bcd-a7b8-a95522caf4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Flow 'volume_create_manager' (0295035f-3267-46c8-b0e1-c1382e54d5bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1b0362fa-48a5-4f5d-8e92-48fb16d8b9c7 tempest-CreateVolumesFromImageTest-1916963880 None] Created volume successfully.
Jul 03 13:13:19 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003 1073741824" returned: 0 in 0.827s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:19 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003
Jul 03 13:13:19 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:20 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003" returned: 0 in 0.679s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.564s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-429949673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9483d10-0cd6-4368-a19c-494694c1be9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5470db7dacff488f87ed86dc051ae3ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:18Z,use_quota=True,user_id='cef96de4dc7b4af49315b07f28629cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Creating volume c9483d10-0cd6-4368-a19c-494694c1be9e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:20 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:20 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e 1073741824
Jul 03 13:13:20 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c478c84-226d-4e9a-819e-2546cc39af8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccda5a97-e26b-4193-974c-3f874de84003', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7106f5-f18d-48be-a72f-f1f28f8f8a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:20 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Volume volume-ccda5a97-e26b-4193-974c-3f874de84003 (ccda5a97-e26b-4193-974c-3f874de84003): created successfully
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7106f5-f18d-48be-a72f-f1f28f8f8a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:20 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Flow 'volume_create_manager' (c6cba61a-19b8-4262-a39e-e799c5ec5644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:20 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b09fe1ad-9aa6-4d72-b81b-e19b2ed1e08e tempest-CreateVolumesFromImageTest-1916963880 None] Created volume successfully.
Jul 03 13:13:21 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e 1073741824" returned: 0 in 0.846s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:21 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e
Jul 03 13:13:21 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:22 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e" returned: 0 in 0.649s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.680s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1710133830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefe6f58-3f32-4b2f-b1bd-df169ad2822e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5470db7dacff488f87ed86dc051ae3ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:18Z,use_quota=True,user_id='cef96de4dc7b4af49315b07f28629cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Creating volume eefe6f58-3f32-4b2f-b1bd-df169ad2822e {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:22 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce868cea-e139-4620-b05e-897d222e0e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9483d10-0cd6-4368-a19c-494694c1be9e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:22 devstack sudo[107225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e 1073741824
Jul 03 13:13:22 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb8af21-7c3d-4ac4-95ec-72ff259fd8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:22 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Volume volume-c9483d10-0cd6-4368-a19c-494694c1be9e (c9483d10-0cd6-4368-a19c-494694c1be9e): created successfully
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb8af21-7c3d-4ac4-95ec-72ff259fd8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Flow 'volume_create_manager' (e2dbc064-44df-4bd5-ae30-38774c8e4235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-10ac5c2a-76af-45d9-bc32-fa9307716c41 tempest-CreateVolumesFromImageTest-1916963880 None] Created volume successfully.
Jul 03 13:13:22 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e 1073741824" returned: 0 in 0.882s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:23 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e
Jul 03 13:13:23 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:23 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e" returned: 0 in 0.679s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.952s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1490547996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5109f6e1-3e34-43a1-abb9-8981c8e74415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5470db7dacff488f87ed86dc051ae3ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:19Z,use_quota=True,user_id='cef96de4dc7b4af49315b07f28629cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Creating volume 5109f6e1-3e34-43a1-abb9-8981c8e74415 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:23 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:23 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415 1073741824
Jul 03 13:13:23 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8ba1c4-4ad3-4222-b108-fae812df673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b4d6ac-d47f-4f86-88d1-f3ffda4b543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Volume volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e (eefe6f58-3f32-4b2f-b1bd-df169ad2822e): created successfully
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b4d6ac-d47f-4f86-88d1-f3ffda4b543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Flow 'volume_create_manager' (8ae1c805-af78-4158-bc4a-651492c6040b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8dd1da05-e564-4d02-b963-86450bf10879 tempest-CreateVolumesFromImageTest-1916963880 None] Created volume successfully.
Jul 03 13:13:24 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415 1073741824" returned: 0 in 0.828s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:24 devstack sudo[107240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415
Jul 03 13:13:24 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:25 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415" returned: 0 in 0.693s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:13:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b931e6e8-9ffb-423b-bc8b-d6cd993dc838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5109f6e1-3e34-43a1-abb9-8981c8e74415', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bef16d-2548-4ee6-819d-972a0925302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Volume volume-5109f6e1-3e34-43a1-abb9-8981c8e74415 (5109f6e1-3e34-43a1-abb9-8981c8e74415): created successfully
Jul 03 13:13:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bef16d-2548-4ee6-819d-972a0925302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Flow 'volume_create_manager' (a3434df4-8b5f-4d6e-aa35-eb15a6c46634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-68e1537a-53cb-418f-96e5-c7a4290df843 tempest-CreateVolumesFromImageTest-1916963880 None] Created volume successfully.
Jul 03 13:13:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "cinder-5109f6e1-3e34-43a1-abb9-8981c8e74415-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-5109f6e1-3e34-43a1-abb9-8981c8e74415-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "cinder-quobyte-5109f6e1-3e34-43a1-abb9-8981c8e74415" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-quobyte-5109f6e1-3e34-43a1-abb9-8981c8e74415" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7021e2b4-2933-4826-a139-5188b31398f7]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:26 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415
Jul 03 13:13:26 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:27 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415" returned: 0 in 0.774s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:27 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415
Jul 03 13:13:27 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:27 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-5109f6e1-3e34-43a1-abb9-8981c8e74415" returned: 0 in 0.687s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-quobyte-5109f6e1-3e34-43a1-abb9-8981c8e74415" released by "delete_volume" :: held 1.500s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:27 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Created reservations ['6e9d9302-6706-4211-87dd-51fa67ad39a0', '7550cd54-c638-4b97-9a5e-54f95430b2ae', 'fda40f1a-af19-4bbb-8aec-0b4c743a7945', '20a1193a-9a1a-414a-bab4-3af5219260f3'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:28 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:13:28 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "cinder-eefe6f58-3f32-4b2f-b1bd-df169ad2822e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-eefe6f58-3f32-4b2f-b1bd-df169ad2822e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "cinder-quobyte-eefe6f58-3f32-4b2f-b1bd-df169ad2822e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-quobyte-eefe6f58-3f32-4b2f-b1bd-df169ad2822e" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f84bf4-2bb4-422f-a884-ba1160ad20ff]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:28 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.723s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:13:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Deleted volume successfully.
Jul 03 13:13:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-00541f8d-bc03-411b-b3f9-4f3e98335fcd tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-5109f6e1-3e34-43a1-abb9-8981c8e74415-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:28 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e
Jul 03 13:13:28 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:29 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e" returned: 0 in 0.797s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:29 devstack sudo[107259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e
Jul 03 13:13:29 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:30 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-eefe6f58-3f32-4b2f-b1bd-df169ad2822e" returned: 0 in 0.674s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-quobyte-eefe6f58-3f32-4b2f-b1bd-df169ad2822e" released by "delete_volume" :: held 1.514s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Created reservations ['d34e43df-9edc-4974-997a-9a246320fe3e', 'd32c9283-a5dc-4c9e-8ab9-50c61da1965e', '2f94ca68-3d18-494b-930c-bf664866736a', '49808bb0-0489-4732-af11-1b06fc936b0c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:30 devstack sudo[107262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:13:30 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "cinder-c9483d10-0cd6-4368-a19c-494694c1be9e-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-c9483d10-0cd6-4368-a19c-494694c1be9e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "cinder-quobyte-c9483d10-0cd6-4368-a19c-494694c1be9e" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-quobyte-c9483d10-0cd6-4368-a19c-494694c1be9e" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e337b9d-c5c2-4cdc-9b80-c687d02fc965]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:30 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.692s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:13:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Deleted volume successfully.
Jul 03 13:13:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f15084e7-c265-438c-a94b-5ec2c1e35d75 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-eefe6f58-3f32-4b2f-b1bd-df169ad2822e-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:31 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e
Jul 03 13:13:31 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:31 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e" returned: 0 in 0.805s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:31 devstack sudo[107271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e
Jul 03 13:13:31 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:32 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c9483d10-0cd6-4368-a19c-494694c1be9e" returned: 0 in 0.682s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:32 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-quobyte-c9483d10-0cd6-4368-a19c-494694c1be9e" released by "delete_volume" :: held 1.535s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:32 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Created reservations ['124a5f29-c96d-434e-b6cf-28a83466b721', '54214104-be7d-4ae4-9058-01e485001133', 'be908d23-9732-409a-9475-c1320a1a7642', '4ad58117-d073-435c-a755-a23042b6414b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:32 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:13:32 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "cinder-ccda5a97-e26b-4193-974c-3f874de84003-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-ccda5a97-e26b-4193-974c-3f874de84003-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "cinder-quobyte-ccda5a97-e26b-4193-974c-3f874de84003" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-quobyte-ccda5a97-e26b-4193-974c-3f874de84003" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4749c732-eb2c-49be-b426-1e9b1afb5cd0]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:33 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.725s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:13:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Deleted volume successfully.
Jul 03 13:13:33 devstack sudo[107277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003
Jul 03 13:13:33 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5b911cb8-8163-4167-bdcd-529f980a38b9 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-c9483d10-0cd6-4368-a19c-494694c1be9e-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:33 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003" returned: 0 in 0.802s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:34 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003
Jul 03 13:13:34 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:34 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ccda5a97-e26b-4193-974c-3f874de84003" returned: 0 in 0.696s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-quobyte-ccda5a97-e26b-4193-974c-3f874de84003" released by "delete_volume" :: held 1.542s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:34 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Created reservations ['b0b06c7c-3208-4b34-81d2-02b04d8960fd', 'f29af27a-29c7-4f76-8399-edb6e28216ad', 'e8331db4-f6ed-445b-9d0b-ad5422a4cb68', '8ff2b8e0-b57a-427d-a122-70c274dc79ef'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:34 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:13:34 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "cinder-64e783d9-6aa0-41f0-807d-083b46d112e0-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-64e783d9-6aa0-41f0-807d-083b46d112e0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "cinder-quobyte-64e783d9-6aa0-41f0-807d-083b46d112e0" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-quobyte-64e783d9-6aa0-41f0-807d-083b46d112e0" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[760c8204-4eb9-4a56-befb-aa0d498f50c1]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:35 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.694s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:35 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:13:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Deleted volume successfully.
Jul 03 13:13:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-d8772ff5-90b2-410b-a683-0781016ff0e4 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-ccda5a97-e26b-4193-974c-3f874de84003-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:35 devstack sudo[107288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0
Jul 03 13:13:35 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:36 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0" returned: 0 in 0.799s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:36 devstack sudo[107294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0
Jul 03 13:13:36 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:36 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-64e783d9-6aa0-41f0-807d-083b46d112e0" returned: 0 in 0.694s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-quobyte-64e783d9-6aa0-41f0-807d-083b46d112e0" released by "delete_volume" :: held 1.538s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Created reservations ['b9c61669-3a9f-484a-84aa-ebfcd2f8adbb', '836f9a58-6c3b-46f4-8d59-c2d4a89900e3', '34800224-e039-4445-a5e9-ddbba1215409', '1631eb11-b491-4410-9d91-5873eef5fbea'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:37 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:13:37 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:37 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.716s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:13:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Deleted volume successfully.
Jul 03 13:13:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0011f590-8175-43b1-a2c9-88ba3da7fb86 tempest-CreateVolumesFromImageTest-1916963880 None] Lock "cinder-64e783d9-6aa0-41f0-807d-083b46d112e0-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:47 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=32,cinder:UPDATE=55,cinder:DELETE=6,cinder:INSERT=14 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:13:47 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=55,cinder:SELECT=38,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:13:54 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:13:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (6847c60e-7353-4c86-ae7d-1895e1549d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9e0171-321b-43a0-aa8c-213b2a5ab901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9e0171-321b-43a0-aa8c-213b2a5ab901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2023339779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02518051-4009-4bed-9d8f-ca2f27cce766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:55Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8437c12-c7af-486e-8260-f24c18968a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8437c12-c7af-486e-8260-f24c18968a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:54 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303d7e91-737b-4441-a057-aa50d7229f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303d7e91-737b-4441-a057-aa50d7229f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02518051-4009-4bed-9d8f-ca2f27cce766', 'volume_name': 'volume-02518051-4009-4bed-9d8f-ca2f27cce766', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c232402-4b42-4afc-8453-7c272c27095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c232402-4b42-4afc-8453-7c272c27095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49054bea-63fd-4429-951b-5666a0093e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:55 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume 02518051-4009-4bed-9d8f-ca2f27cce766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02518051-4009-4bed-9d8f-ca2f27cce766', 'volume_size': 1}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2023339779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02518051-4009-4bed-9d8f-ca2f27cce766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:55Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Creating volume 02518051-4009-4bed-9d8f-ca2f27cce766 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:55 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:55 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766 1073741824
Jul 03 13:13:55 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (11a744fb-11a4-4267-ac84-1ff3c7a7ba68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e125fa4-dc2d-4a22-a6b8-58efbeab8e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e125fa4-dc2d-4a22-a6b8-58efbeab8e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-199964604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:55Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d336e39c-45cf-431d-b4e4-1e98323d6048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d336e39c-45cf-431d-b4e4-1e98323d6048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cec80a3-a374-44a3-8eed-f96e65ca336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cec80a3-a374-44a3-8eed-f96e65ca336a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9', 'volume_name': 'volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af504064-71e7-4260-af03-181a1014570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af504064-71e7-4260-af03-181a1014570c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f46f009-83c3-462e-af0a-4e9bb4b15306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:55 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9', 'volume_size': 1}
Jul 03 13:13:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:56 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766 1073741824" returned: 0 in 1.168s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:56 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766
Jul 03 13:13:56 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:57 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766" returned: 0 in 0.776s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-199964604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:55Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Creating volume ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:57 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49054bea-63fd-4429-951b-5666a0093e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02518051-4009-4bed-9d8f-ca2f27cce766', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5657fa-63bf-4236-87c7-60bb9524fe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:57 devstack sudo[107352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 1073741824
Jul 03 13:13:57 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume volume-02518051-4009-4bed-9d8f-ca2f27cce766 (02518051-4009-4bed-9d8f-ca2f27cce766): created successfully
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5657fa-63bf-4236-87c7-60bb9524fe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (6847c60e-7353-4c86-ae7d-1895e1549d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-60c26e17-cf0c-46bb-b9ab-8632a174edbd tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created volume successfully.
Jul 03 13:13:58 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 1073741824" returned: 0 in 1.161s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:58 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9
Jul 03 13:13:58 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Flow 'volume_create_manager' (feb3bd93-45a7-4559-bb2f-c0454e2499b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29152451-80c2-43eb-83b8-d0e1639df96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29152451-80c2-43eb-83b8-d0e1639df96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e35936-830c-40c0-aa2b-f4969a8d4752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a8cae81f04d4b7a921816b755febfe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:59Z,use_quota=True,user_id='6c4bdd0904944971a34a2791ca6d2b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67b6eef-bddf-4d85-99aa-c4c7cd0e2f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67b6eef-bddf-4d85-99aa-c4c7cd0e2f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a31ec20-33f8-4e08-b370-6197c1e62d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (3dad0011-ad80-4bc4-bc67-1c6caf0e1499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373fec67-273e-4a61-a675-d3a943590b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373fec67-273e-4a61-a675-d3a943590b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-373703500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1612301-9ad0-49d5-82cc-8aed6d7caac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:59Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fe9a82-ca96-4415-802b-b5c4cc6415fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fe9a82-ca96-4415-802b-b5c4cc6415fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c9068c-9384-4a90-a4e3-0362b2492d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c9068c-9384-4a90-a4e3-0362b2492d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1612301-9ad0-49d5-82cc-8aed6d7caac1', 'volume_name': 'volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c611b6be-14ab-4645-baf0-ef06b8529194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c611b6be-14ab-4645-baf0-ef06b8529194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629c1ed5-2ba5-42cf-aa19-8db481e8df4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume c1612301-9ad0-49d5-82cc-8aed6d7caac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1', 'volume_size': 1}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a31ec20-33f8-4e08-b370-6197c1e62d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b1e35936-830c-40c0-aa2b-f4969a8d4752', 'volume_name': 'volume-b1e35936-830c-40c0-aa2b-f4969a8d4752', 'volume_size': 1, 'image_id': 'fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fdc3d0a803b0f594ec713cb0a3e9e420', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a8cae81f04d4b7a921816b755febfe2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e5862aa484bb61072eb3e652f52e8f8741aa1b5d52b88b7d29228dd95fe232463781b3cf217e7bb49cfa0fb5e0a19b7c7c3404c5d4055ecf8cd352b142f6e10', 'id': 'fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'created_at': datetime.datetime(2026, 7, 3, 11, 13, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd686eea-703d-49e3-b3b8-8c5ac4b644ee/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273abe2c440>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cff7df-c8a1-4078-b875-b86a919d0461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cff7df-c8a1-4078-b875-b86a919d0461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1ac59b-aa4a-4c7f-9985-c7450a6c3040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Volume b1e35936-830c-40c0-aa2b-f4969a8d4752: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b1e35936-830c-40c0-aa2b-f4969a8d4752', 'volume_size': 1, 'image_id': 'fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fdc3d0a803b0f594ec713cb0a3e9e420', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a8cae81f04d4b7a921816b755febfe2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e5862aa484bb61072eb3e652f52e8f8741aa1b5d52b88b7d29228dd95fe232463781b3cf217e7bb49cfa0fb5e0a19b7c7c3404c5d4055ecf8cd352b142f6e10', 'id': 'fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'created_at': datetime.datetime(2026, 7, 3, 11, 13, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd686eea-703d-49e3-b3b8-8c5ac4b644ee/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273abe2c440>}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Trying to clone b1e35936-830c-40c0-aa2b-f4969a8d4752 from image fd686eea-703d-49e3-b3b8-8c5ac4b644ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jul 03 13:13:59 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9" returned: 0 in 0.971s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.231s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-373703500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1612301-9ad0-49d5-82cc-8aed6d7caac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:59Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Creating volume c1612301-9ad0-49d5-82cc-8aed6d7caac1 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:59 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:59 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1 1073741824
Jul 03 13:13:59 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f46f009-83c3-462e-af0a-4e9bb4b15306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac7cca0-6b9f-4295-8dea-edf490a8a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 (ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9): created successfully
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac7cca0-6b9f-4295-8dea-edf490a8a314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (11a744fb-11a4-4267-ac84-1ff3c7a7ba68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jul 03 13:13:59 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 13:13:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9030f40e-3bcf-4e07-8c8d-f463925a0d36 tempest-CreateVolumesFromSnapshotTest-860798762 None] Created volume successfully.
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5b48f5-c953-46f6-960f-c712b9faab60]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (e85fe953-90da-46a9-abb0-c34113c6455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca6e0ce-04fd-42ac-b208-4d0472bacf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca6e0ce-04fd-42ac-b208-4d0472bacf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1913256345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ad2170-8c92-4f73-996d-e413a3b91907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:00Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de094369-bbdb-419e-98cb-349612d9a55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de094369-bbdb-419e-98cb-349612d9a55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4480de16-c2f2-4702-aadc-cd932ac7cc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4480de16-c2f2-4702-aadc-cd932ac7cc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ad2170-8c92-4f73-996d-e413a3b91907', 'volume_name': 'volume-44ad2170-8c92-4f73-996d-e413a3b91907', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b60f2fc-a208-4ab1-80aa-3cb7dd865150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b60f2fc-a208-4ab1-80aa-3cb7dd865150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:59 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227fdb39-3014-4d07-91fb-918f8a43605b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:59 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume 44ad2170-8c92-4f73-996d-e413a3b91907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ad2170-8c92-4f73-996d-e413a3b91907', 'volume_size': 1}
Jul 03 13:13:59 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (33e5d951-1c45-43a8-8273-5a8eaf25c215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270d915e-9578-4b81-a7e4-6d970d980ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270d915e-9578-4b81-a7e4-6d970d980ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1012740464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eddaa4e-77e4-4d7d-bee4-cc3289493a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:00Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de658ef-0e01-4cc7-bb4b-62798b436f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de658ef-0e01-4cc7-bb4b-62798b436f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113032f1-e695-499a-b829-15915f8dfa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113032f1-e695-499a-b829-15915f8dfa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eddaa4e-77e4-4d7d-bee4-cc3289493a09', 'volume_name': 'volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5aa7ce-6d19-40cb-8c51-915563e56d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5aa7ce-6d19-40cb-8c51-915563e56d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd919ea-c9be-4d40-a805-0774bb9f47e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:00 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume 8eddaa4e-77e4-4d7d-bee4-cc3289493a09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09', 'volume_size': 1}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:00 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1 1073741824" returned: 0 in 1.235s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:00 devstack sudo[107370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1
Jul 03 13:14:00 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Flow 'volume_create_manager' (ab1a69fd-7e45-4f87-a26e-e7b058ccbfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a5a327-d898-4863-a594-0e1ba5c8c1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:00 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD" returned: 0 in 1.272s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a5a327-d898-4863-a594-0e1ba5c8c1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5d5fb6-2b90-4547-9833-a60e5c1fc632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709de5c16ab24fcaba940db896829bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:01Z,use_quota=True,user_id='03ac3c09cd434df795b027bd4761a54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88d44e18-8fb9-41e8-9528-6f9000c8ed82),volume_type_id=88d44e18-8fb9-41e8-9528-6f9000c8ed82)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ff814f-cc00-4256-bd93-90f1c9a9825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ff814f-cc00-4256-bd93-90f1c9a9825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d695307-7aa4-43d0-93d4-e6617c59e34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:00 devstack cinder-volume[86763]: DEBUG cinder.image.glance [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Creating Keystone auth plugin from conf {{(pid=86763) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:14:01 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD
Jul 03 13:14:01 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (68ee21f3-c32f-4c57-a4ae-7565af3da457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4748e230-6bb7-4168-b890-3ca83326ba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4748e230-6bb7-4168-b890-3ca83326ba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-978177015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c64705-24a2-4b4f-91fe-753b3c121f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:01Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c97224-9275-46a1-af1f-3eb140ba20eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c97224-9275-46a1-af1f-3eb140ba20eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4432935-78f2-4388-8c23-501e48ff6fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4432935-78f2-4388-8c23-501e48ff6fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c64705-24a2-4b4f-91fe-753b3c121f23', 'volume_name': 'volume-e5c64705-24a2-4b4f-91fe-753b3c121f23', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dec8563-a566-4604-a453-78299521057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dec8563-a566-4604-a453-78299521057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4755260a-ca17-4d50-95a6-ec63af80d21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume e5c64705-24a2-4b4f-91fe-753b3c121f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c64705-24a2-4b4f-91fe-753b3c121f23', 'volume_size': 1}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d695307-7aa4-43d0-93d4-e6617c59e34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b5d5fb6-2b90-4547-9833-a60e5c1fc632', 'volume_name': 'volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632', 'volume_size': 1, 'image_id': '66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '13a415f95584d6385e35f0ab31fcad03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '709de5c16ab24fcaba940db896829bf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eac5836b367bcd622189682b47907ff3fb8c252a79e4325fd061f3bd0870cfbefec68b5668c7652f0f8c98e7ae427ff0d013bccf52a5207a02cfc1f195e7cf22', 'id': '66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'created_at': datetime.datetime(2026, 7, 3, 11, 13, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 13, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66e28fbf-5a96-4007-8673-01fbb6ffdb8f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b6131790>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb478d6-8b40-4541-9208-6354672f0f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb478d6-8b40-4541-9208-6354672f0f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68859f9b-22db-4a82-9c09-2805e78355af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Volume 6b5d5fb6-2b90-4547-9833-a60e5c1fc632: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632', 'volume_size': 1, 'image_id': '66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '13a415f95584d6385e35f0ab31fcad03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '709de5c16ab24fcaba940db896829bf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eac5836b367bcd622189682b47907ff3fb8c252a79e4325fd061f3bd0870cfbefec68b5668c7652f0f8c98e7ae427ff0d013bccf52a5207a02cfc1f195e7cf22', 'id': '66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'created_at': datetime.datetime(2026, 7, 3, 11, 13, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 13, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66e28fbf-5a96-4007-8673-01fbb6ffdb8f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b6131790>}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Trying to clone 6b5d5fb6-2b90-4547-9833-a60e5c1fc632 from image 66e28fbf-5a96-4007-8673-01fbb6ffdb8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'metadata': {}}]). {{(pid=86763) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Jul 03 13:14:01 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Jul 03 13:14:01 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1" returned: 0 in 0.936s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1913256345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ad2170-8c92-4f73-996d-e413a3b91907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:00Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Creating volume 44ad2170-8c92-4f73-996d-e413a3b91907 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:01 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:01 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907 1073741824
Jul 03 13:14:01 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (c12779b8-f1ca-4aef-a90a-d6842f5ecb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9856fb-4468-44e9-be6f-4c6653cddfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629c1ed5-2ba5-42cf-aa19-8db481e8df4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33a6643-8cf2-4a20-aeae-2208b0b828fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1 (c1612301-9ad0-49d5-82cc-8aed6d7caac1): created successfully
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33a6643-8cf2-4a20-aeae-2208b0b828fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (3dad0011-ad80-4bc4-bc67-1c6caf0e1499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9856fb-4468-44e9-be6f-4c6653cddfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835179117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332976be-77b9-42d5-a955-af70d4fb2637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:01Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71611b44-b3c6-4620-aabc-722e1c80c577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71611b44-b3c6-4620-aabc-722e1c80c577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa5538c-94c5-4a04-b5d2-9f5c890e54b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa5538c-94c5-4a04-b5d2-9f5c890e54b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332976be-77b9-42d5-a955-af70d4fb2637', 'volume_name': 'volume-332976be-77b9-42d5-a955-af70d4fb2637', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d022cbff-c0c9-46c4-99eb-bc3d936ee50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d022cbff-c0c9-46c4-99eb-bc3d936ee50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb50cf60-0e85-4625-98c6-bc264fb9f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume 332976be-77b9-42d5-a955-af70d4fb2637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332976be-77b9-42d5-a955-af70d4fb2637', 'volume_size': 1}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ccd71a-6067-410b-8453-e11c9f8d3cad]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1f614bc7-913e-4b80-b9f3-e24e306bc5b5 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created volume successfully.
Jul 03 13:14:01 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD
Jul 03 13:14:01 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:01 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD" returned: 1 in 1.076s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Temporary image fd686eea-703d-49e3-b3b8-8c5ac4b644ee is fetched for user 6c4bdd0904944971a34a2791ca6d2b6e. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[109ce907-d667-4ba2-935b-6e885c2afee6]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:02 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD
Jul 03 13:14:02 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:02 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907 1073741824" returned: 0 in 0.924s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:02 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907
Jul 03 13:14:02 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:02 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD" returned: 0 in 0.871s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:02 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD
Jul 03 13:14:02 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:02 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:02 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD
Jul 03 13:14:02 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:03 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907" returned: 0 in 0.753s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.046s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1012740464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eddaa4e-77e4-4d7d-bee4-cc3289493a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:00Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Creating volume 8eddaa4e-77e4-4d7d-bee4-cc3289493a09 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:03 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:03 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09 1073741824
Jul 03 13:14:03 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227fdb39-3014-4d07-91fb-918f8a43605b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ad2170-8c92-4f73-996d-e413a3b91907', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b9b1b0-6aef-4b44-bfdf-57563d1ff95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume volume-44ad2170-8c92-4f73-996d-e413a3b91907 (44ad2170-8c92-4f73-996d-e413a3b91907): created successfully
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b9b1b0-6aef-4b44-bfdf-57563d1ff95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (e85fe953-90da-46a9-abb0-c34113c6455c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-81044d78-1938-4c80-ae0a-856468e01529 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created volume successfully.
Jul 03 13:14:03 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD" returned: 1 in 0.896s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Temporary image 66e28fbf-5a96-4007-8673-01fbb6ffdb8f is fetched for user 03ac3c09cd434df795b027bd4761a54b. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c03f687-0a66-4d78-9257-0a4a57dce58e]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:03 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD" returned: 1 in 0.937s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:03 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD
Jul 03 13:14:03 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:04 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09 1073741824" returned: 0 in 1.054s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:04 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09
Jul 03 13:14:04 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:04 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:04 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD
Jul 03 13:14:04 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:05 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09" returned: 0 in 0.712s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.401s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:05 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:05 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] Creating offline snapshot 8d87c50b-e733-4c37-af4c-8125ef8a03ca of volume ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd919ea-c9be-4d40-a805-0774bb9f47e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac4119e-3b7e-4cc3-9c74-36196dee1da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[814d3300-662e-4f1d-a521-87ea71bd31cd]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09 (8eddaa4e-77e4-4d7d-bee4-cc3289493a09): created successfully
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac4119e-3b7e-4cc3-9c74-36196dee1da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (33e5d951-1c45-43a8-8273-5a8eaf25c215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:05 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-82d9a550-52c5-4639-a8f6-8e23f2ddd4c6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created volume successfully.
Jul 03 13:14:05 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD" returned: 1 in 0.806s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:05 devstack sudo[107465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9
Jul 03 13:14:05 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:05 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.719s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:05 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9" returned: 0 in 0.816s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:05 devstack sudo[107477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca 1G
Jul 03 13:14:05 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:06 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca 1G" returned: 0 in 0.780s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:06 devstack sudo[107482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca
Jul 03 13:14:06 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:07 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca" returned: 0 in 0.672s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:07 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca is being set with open permissions: ugo+rw
Jul 03 13:14:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:07 devstack sudo[107487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca
Jul 03 13:14:07 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:08 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca" returned: 0 in 0.672s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:08 devstack sudo[107490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.info
Jul 03 13:14:08 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:08 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.info" returned: 0 in 0.684s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:08 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.info is being set with open permissions: ugo+rw
Jul 03 13:14:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:08 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.info
Jul 03 13:14:08 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:09 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.info" returned: 0 in 0.693s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.415s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.311s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-978177015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c64705-24a2-4b4f-91fe-753b3c121f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:01Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Creating volume e5c64705-24a2-4b4f-91fe-753b3c121f23 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:09 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:09 devstack sudo[107496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23 1073741824
Jul 03 13:14:09 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b3b9af75-cb87-4321-b513-911577375b12 tempest-CreateVolumesFromSnapshotTest-860798762 None] Create snapshot completed successfully
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (90a6497f-1960-499b-8530-6413e6c4c20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c63a73-108e-46dd-84c7-518279bb06cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c63a73-108e-46dd-84c7-518279bb06cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-568839205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894055c8-93ef-4efa-8c61-4a5fdf183ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:10Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4436ae98-e5b8-426b-ae83-0f41e78ee445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:10 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4436ae98-e5b8-426b-ae83-0f41e78ee445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2919c7-ab0e-4006-9be8-13360c43240c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2919c7-ab0e-4006-9be8-13360c43240c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '894055c8-93ef-4efa-8c61-4a5fdf183ac5', 'volume_name': 'volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d468cbd5-9535-431f-bc04-37230053aee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d468cbd5-9535-431f-bc04-37230053aee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c01c273-1aab-486c-957a-8101cefe2de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume 894055c8-93ef-4efa-8c61-4a5fdf183ac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5', 'volume_size': 1}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23 1073741824" returned: 0 in 1.008s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:10 devstack sudo[107501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23
Jul 03 13:14:10 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (00ffaf0c-12f5-46d9-856d-285baa1a5e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d17d2fd-dcc2-446a-b25f-2b9260b53740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d17d2fd-dcc2-446a-b25f-2b9260b53740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032839130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78da3b5-7ab1-4cd1-9de2-86b659653af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:11Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc434b92-dc9c-4ffb-921f-c0242ed54319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc434b92-dc9c-4ffb-921f-c0242ed54319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd2c46f-ecc3-4cec-b6b6-9b13741aee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd2c46f-ecc3-4cec-b6b6-9b13741aee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a78da3b5-7ab1-4cd1-9de2-86b659653af8', 'volume_name': 'volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f4ed5f-9b0a-453d-8755-80035c81aa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f4ed5f-9b0a-453d-8755-80035c81aa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d557f5d-04fc-4a06-bd3b-381b2b95ddf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume a78da3b5-7ab1-4cd1-9de2-86b659653af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8', 'volume_size': 1}
Jul 03 13:14:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (e56a0df6-7560-44f0-8e56-b0e6d654f051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3affc5f-5081-4cea-9df8-3737ee0c77de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3affc5f-5081-4cea-9df8-3737ee0c77de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098793529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a6b43c-6e0c-4008-868a-b9444dbd16df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:11Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f98bdc-1295-4c94-ada5-21d8a54a1f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f98bdc-1295-4c94-ada5-21d8a54a1f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e832f79-4ca9-439d-bea0-5393483ea1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e832f79-4ca9-439d-bea0-5393483ea1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a6b43c-6e0c-4008-868a-b9444dbd16df', 'volume_name': 'volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fc0586-7840-4993-898b-3ea5e8c98a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fc0586-7840-4993-898b-3ea5e8c98a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce20ab9-6c73-4753-a9f3-ae61bf9d89a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume b2a6b43c-6e0c-4008-868a-b9444dbd16df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df', 'volume_size': 1}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:11 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23" returned: 0 in 0.778s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.674s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835179117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332976be-77b9-42d5-a955-af70d4fb2637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175241fc652f4e1995a75d3b2f6b906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:01Z,use_quota=True,user_id='b0c33298ca4d4d778cb36bc39cbb7452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Creating volume 332976be-77b9-42d5-a955-af70d4fb2637 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:11 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4755260a-ca17-4d50-95a6-ec63af80d21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c64705-24a2-4b4f-91fe-753b3c121f23', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:11 devstack sudo[107505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637 1073741824
Jul 03 13:14:11 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7499102-7098-4c3f-8867-b82b4514d4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume volume-e5c64705-24a2-4b4f-91fe-753b3c121f23 (e5c64705-24a2-4b4f-91fe-753b3c121f23): created successfully
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7499102-7098-4c3f-8867-b82b4514d4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (68ee21f3-c32f-4c57-a4ae-7565af3da457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-87411fe8-be3c-4dbc-b74c-6bfc32d7593b tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created volume successfully.
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (061ad4f5-17e6-46f8-8658-14ae026a64d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750a0dfd-6d63-4691-8c5a-a604e382e027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750a0dfd-6d63-4691-8c5a-a604e382e027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-173846220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4333ad6f-658c-4758-aa48-024c4341d97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:12Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c9bff2-619c-4eaf-ae3c-7ca785442067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c9bff2-619c-4eaf-ae3c-7ca785442067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8787dd-612c-4460-81f9-01dc6b3165fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8787dd-612c-4460-81f9-01dc6b3165fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4333ad6f-658c-4758-aa48-024c4341d97a', 'volume_name': 'volume-4333ad6f-658c-4758-aa48-024c4341d97a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba72fba-1a21-4594-89bf-44ecd3d7142f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba72fba-1a21-4594-89bf-44ecd3d7142f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d6c293-2780-469b-8999-e1daaa6f9685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume 4333ad6f-658c-4758-aa48-024c4341d97a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4333ad6f-658c-4758-aa48-024c4341d97a', 'volume_size': 1}
Jul 03 13:14:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (a599ab1a-c240-4445-a546-f45785ff6bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c601151-de61-4851-9eb3-43288be0f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c601151-de61-4851-9eb3-43288be0f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-138767735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d738098-ae57-4dd3-9e50-268b81c130f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:12Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e216f8-5bfc-4b61-b178-f300d65a7ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e216f8-5bfc-4b61-b178-f300d65a7ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ec3e01-cfcc-458e-898e-75e54784285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ec3e01-cfcc-458e-898e-75e54784285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d738098-ae57-4dd3-9e50-268b81c130f1', 'volume_name': 'volume-0d738098-ae57-4dd3-9e50-268b81c130f1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3e975a-8c6f-46dd-ae37-ebd8b287f842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3e975a-8c6f-46dd-ae37-ebd8b287f842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18d1574-6eb8-4626-ba86-7c1b96b28f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:12 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume 0d738098-ae57-4dd3-9e50-268b81c130f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d738098-ae57-4dd3-9e50-268b81c130f1', 'volume_size': 1}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:12 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637 1073741824" returned: 0 in 0.927s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:12 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637
Jul 03 13:14:12 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:12 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637" returned: 0 in 0.670s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.297s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e35936-830c-40c0-aa2b-f4969a8d4752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a8cae81f04d4b7a921816b755febfe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:59Z,use_quota=True,user_id='6c4bdd0904944971a34a2791ca6d2b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Creating volume b1e35936-830c-40c0-aa2b-f4969a8d4752 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:13 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:13 devstack sudo[107514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 1073741824
Jul 03 13:14:13 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb50cf60-0e85-4625-98c6-bc264fb9f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332976be-77b9-42d5-a955-af70d4fb2637', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bcc371-9e52-4bdc-be7b-d575a8f48a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:13 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Volume volume-332976be-77b9-42d5-a955-af70d4fb2637 (332976be-77b9-42d5-a955-af70d4fb2637): created successfully
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bcc371-9e52-4bdc-be7b-d575a8f48a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Flow 'volume_create_manager' (c12779b8-f1ca-4aef-a90a-d6842f5ecb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-84b719cb-9057-4ffe-a7f9-bbbc0b10b64a tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created volume successfully.
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-332976be-77b9-42d5-a955-af70d4fb2637-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-332976be-77b9-42d5-a955-af70d4fb2637-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-quobyte-332976be-77b9-42d5-a955-af70d4fb2637" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-332976be-77b9-42d5-a955-af70d4fb2637" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceaee08-6127-471a-9bc8-7022aae68617]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:13 devstack sudo[107519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637
Jul 03 13:14:13 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:13 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 1073741824" returned: 0 in 0.954s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:14 devstack sudo[107521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752
Jul 03 13:14:14 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:14 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637" returned: 0 in 0.812s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:14 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637
Jul 03 13:14:14 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:14 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752" returned: 0 in 0.713s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.497s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5d5fb6-2b90-4547-9833-a60e5c1fc632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709de5c16ab24fcaba940db896829bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:01Z,use_quota=True,user_id='03ac3c09cd434df795b027bd4761a54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88d44e18-8fb9-41e8-9528-6f9000c8ed82),volume_type_id=88d44e18-8fb9-41e8-9528-6f9000c8ed82)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Creating volume 6b5d5fb6-2b90-4547-9833-a60e5c1fc632 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:14 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:14 devstack sudo[107529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 1073741824
Jul 03 13:14:14 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Attempting download of fd686eea-703d-49e3-b3b8-8c5ac4b644ee ((None, [{'url': 'file:///opt/stack/data/glance/images/fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'metadata': {}}])) to volume b1e35936-830c-40c0-aa2b-f4969a8d4752. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[187fbbf7-8987-4fbc-916d-832dfbf873f5]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_0kvazkoq {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:14 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_0kvazkoq
Jul 03 13:14:14 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:15 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-332976be-77b9-42d5-a955-af70d4fb2637" returned: 0 in 0.646s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-332976be-77b9-42d5-a955-af70d4fb2637" released by "delete_volume" :: held 1.515s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created reservations ['25978dc7-5376-47f6-8ff5-a8fe4cfb7586', '8733712f-6c82-49f9-bef3-112e1c8e103e', '63c2b8ef-62c4-433d-b779-e4fddaf9b6c3', '93d7a856-7291-4715-b05f-8dd516c31b67'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:15 devstack sudo[107534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:15 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:15 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 1073741824" returned: 0 in 0.922s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:15 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_0kvazkoq" returned: 0 in 0.862s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_0kvazkoq {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:15 devstack sudo[107543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632
Jul 03 13:14:15 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-e5c64705-24a2-4b4f-91fe-753b3c121f23-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-e5c64705-24a2-4b4f-91fe-753b3c121f23-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:15 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_0kvazkoq
Jul 03 13:14:15 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-quobyte-e5c64705-24a2-4b4f-91fe-753b3c121f23" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-e5c64705-24a2-4b4f-91fe-753b3c121f23" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e34427-e32d-4fce-9417-6f416c946e1a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:16 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23
Jul 03 13:14:16 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:16 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.818s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Deleted volume successfully.
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e0195ae3-f996-49d2-8cc2-e0ecb7403617 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-332976be-77b9-42d5-a955-af70d4fb2637-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:16 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632" returned: 0 in 0.872s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.081s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-568839205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894055c8-93ef-4efa-8c61-4a5fdf183ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:10Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Creating volume 894055c8-93ef-4efa-8c61-4a5fdf183ac5 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:16 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:16 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_0kvazkoq" returned: 1 in 0.957s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_0kvazkoq' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e3f5e7-4075-4ff2-9691-44e2c4261e80]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:16 devstack sudo[107552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5 1073741824
Jul 03 13:14:16 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Attempting download of 66e28fbf-5a96-4007-8673-01fbb6ffdb8f ((None, [{'url': 'file:///opt/stack/data/glance/images/66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'metadata': {}}])) to volume 6b5d5fb6-2b90-4547-9833-a60e5c1fc632. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e39678-7974-424f-9b90-d710ccfa9e34]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_b0phqgld {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:16 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD
Jul 03 13:14:16 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:16 devstack sudo[107559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_b0phqgld
Jul 03 13:14:16 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:16 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23" returned: 0 in 0.926s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:16 devstack sudo[107562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23
Jul 03 13:14:16 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:17 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:17 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5 1073741824" returned: 0 in 0.988s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_b0phqgld" returned: 0 in 0.894s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_b0phqgld {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:17 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD" returned: 0 in 1.011s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:17 devstack sudo[107574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5
Jul 03 13:14:17 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:17 devstack sudo[107572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_b0phqgld
Jul 03 13:14:17 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:17 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD
Jul 03 13:14:17 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:17 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-e5c64705-24a2-4b4f-91fe-753b3c121f23" returned: 0 in 0.945s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-e5c64705-24a2-4b4f-91fe-753b3c121f23" released by "delete_volume" :: held 1.936s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:17 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created reservations ['8736010e-02fa-49aa-97c5-5c1660ad1e00', '2ec4e9f0-06a5-45cb-94cc-d9af3755c518', 'c62230fe-84e9-4b5e-9e3c-f4f60bee937a', 'e3cbb31a-165a-473b-bb31-ad091cfea051'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:18 devstack sudo[107578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:18 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-8eddaa4e-77e4-4d7d-bee4-cc3289493a09-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-8eddaa4e-77e4-4d7d-bee4-cc3289493a09-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-quobyte-8eddaa4e-77e4-4d7d-bee4-cc3289493a09" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-8eddaa4e-77e4-4d7d-bee4-cc3289493a09" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b4fefe-ffd2-4018-8fd3-93ce3b22d892]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:18 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09
Jul 03 13:14:18 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:18 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_b0phqgld" returned: 1 in 1.045s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_b0phqgld' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c615558a-8797-4db7-ab85-e1c1912763d9]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:18 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5" returned: 0 in 1.134s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.912s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032839130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78da3b5-7ab1-4cd1-9de2-86b659653af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:11Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Creating volume a78da3b5-7ab1-4cd1-9de2-86b659653af8 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:18 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:18 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD" returned: 1 in 1.211s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] fd686eea-703d-49e3-b3b8-8c5ac4b644ee was raw, converting to raw {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:18 devstack sudo[107588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD
Jul 03 13:14:18 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c01c273-1aab-486c-957a-8101cefe2de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9d5df1-ea45-4145-9f73-8d24beacf0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:18 devstack sudo[107590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8 1073741824
Jul 03 13:14:18 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:18 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752
Jul 03 13:14:18 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:18 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5 (894055c8-93ef-4efa-8c61-4a5fdf183ac5): created successfully
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9d5df1-ea45-4145-9f73-8d24beacf0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:18 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (90a6497f-1960-499b-8530-6413e6c4c20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0fde2fc7-0a14-44d8-82fd-af16863d0288 tempest-CreateVolumesFromSnapshotTest-860798762 None] Created volume successfully.
Jul 03 13:14:18 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.972s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Deleted volume successfully.
Jul 03 13:14:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bb51cc15-a82c-4a2a-8f4b-d4883f03dbc6 tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-e5c64705-24a2-4b4f-91fe-753b3c121f23-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:19 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09" returned: 0 in 1.037s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:19 devstack sudo[107599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09
Jul 03 13:14:19 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:19 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD" returned: 0 in 1.031s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:19 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752" returned: 0 in 0.949s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:19 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fd686eea-703d-49e3-b3b8-8c5ac4b644ee_fchp6njqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:14:19 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 13:14:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:19 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD
Jul 03 13:14:19 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:19 devstack sudo[107611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 1G
Jul 03 13:14:19 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:20 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8 1073741824" returned: 0 in 1.199s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:20 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8
Jul 03 13:14:20 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:20 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8eddaa4e-77e4-4d7d-bee4-cc3289493a09" returned: 0 in 0.829s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-8eddaa4e-77e4-4d7d-bee4-cc3289493a09" released by "delete_volume" :: held 1.940s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created reservations ['5f2b74ed-efe9-4dad-b3c5-0276b7067208', '51852e0a-2d45-4466-8cf4-b1ff626f7365', 'f260df71-987f-4869-b576-46f7dee32409', '996d45f3-b79c-4b1b-bed9-310142ea38ba'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:20 devstack sudo[107616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:20 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-44ad2170-8c92-4f73-996d-e413a3b91907-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-44ad2170-8c92-4f73-996d-e413a3b91907-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-quobyte-44ad2170-8c92-4f73-996d-e413a3b91907" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-44ad2170-8c92-4f73-996d-e413a3b91907" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[485d046f-a4d9-41f9-8edb-68d465ea5702]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:20 devstack sudo[107624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907
Jul 03 13:14:20 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:20 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 1G" returned: 0 in 1.001s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:20 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD" returned: 1 in 1.174s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] 66e28fbf-5a96-4007-8673-01fbb6ffdb8f was raw, converting to raw {{(pid=86763) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8e7a01-d79a-4526-a098-57f51f805ebc]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:20 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632
Jul 03 13:14:20 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:21 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:21 devstack sudo[107629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752
Jul 03 13:14:21 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8" returned: 0 in 0.969s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] <== create_volume: return (2244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.782s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098793529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a6b43c-6e0c-4008-868a-b9444dbd16df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:11Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Creating volume b2a6b43c-6e0c-4008-868a-b9444dbd16df {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:21 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d557f5d-04fc-4a06-bd3b-381b2b95ddf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:21 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df 1073741824
Jul 03 13:14:21 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43979d6c-7250-4b54-bc8b-b2a36c6fe735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:21 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8 (a78da3b5-7ab1-4cd1-9de2-86b659653af8): created successfully
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43979d6c-7250-4b54-bc8b-b2a36c6fe735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (00ffaf0c-12f5-46d9-856d-285baa1a5e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3b6e33b1-04d1-4e96-9e9f-25744a3e9ecf tempest-CreateVolumesFromSnapshotTest-860798762 None] Created volume successfully.
Jul 03 13:14:21 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.269s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Deleted volume successfully.
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13b9059c-b17d-4a05-b869-67683af95fff tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-8eddaa4e-77e4-4d7d-bee4-cc3289493a09-delete_volume" released by "delete_volume" :: held 3.585s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:21 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907" returned: 0 in 1.170s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:21 devstack sudo[107643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907
Jul 03 13:14:21 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:21 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632" returned: 0 in 1.030s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_66e28fbf-5a96-4007-8673-01fbb6ffdb8f_dlf1o4nvdevstack@QuobyteHD, size 0.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:14:21 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:21 devstack sudo[107645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 1G
Jul 03 13:14:21 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:21 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752" returned: 0 in 1.081s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:22 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752
Jul 03 13:14:22 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:22 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df 1073741824" returned: 0 in 1.232s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:22 devstack sudo[107653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df
Jul 03 13:14:22 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:22 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-44ad2170-8c92-4f73-996d-e413a3b91907" returned: 0 in 0.813s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-44ad2170-8c92-4f73-996d-e413a3b91907" released by "delete_volume" :: held 2.042s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created reservations ['55779f62-953b-4bde-b787-d39ec5098cfb', '44c13a08-93bd-444b-8d68-81fff1b3e175', 'c7eeb1f6-f317-4cd6-9d00-b0716ecdac99', '94a718c2-90af-4c90-91cc-a224640a1e54'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:22 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 1G" returned: 0 in 0.873s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24528e1-c02c-4f1b-ac90-932202b5d686]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:22 devstack sudo[107659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:22 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-c1612301-9ad0-49d5-82cc-8aed6d7caac1-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-c1612301-9ad0-49d5-82cc-8aed6d7caac1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-quobyte-c1612301-9ad0-49d5-82cc-8aed6d7caac1" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:23 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632
Jul 03 13:14:23 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-c1612301-9ad0-49d5-82cc-8aed6d7caac1" acquired by "delete_volume" :: waited 0.064s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce60e2ac-24a8-4a21-ae74-9d417f87fdff]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:23 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df" returned: 0 in 0.838s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.515s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-173846220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4333ad6f-658c-4758-aa48-024c4341d97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:12Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Creating volume 4333ad6f-658c-4758-aa48-024c4341d97a {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:23 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce20ab9-6c73-4753-a9f3-ae61bf9d89a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d57303-03f1-49b7-89e2-1069a9659fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:23 devstack sudo[107668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a 1073741824
Jul 03 13:14:23 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df (b2a6b43c-6e0c-4008-868a-b9444dbd16df): created successfully
Jul 03 13:14:23 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d57303-03f1-49b7-89e2-1069a9659fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:23 devstack sudo[107667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1
Jul 03 13:14:23 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (e56a0df6-7560-44f0-8e56-b0e6d654f051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752" returned: 1 in 1.385s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Downloaded image fd686eea-703d-49e3-b3b8-8c5ac4b644ee ((None, [{'url': 'file:///opt/stack/data/glance/images/fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'metadata': {}}])) to volume b1e35936-830c-40c0-aa2b-f4969a8d4752 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Temporary image fd686eea-703d-49e3-b3b8-8c5ac4b644ee for user 6c4bdd0904944971a34a2791ca6d2b6e is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Marking volume b1e35936-830c-40c0-aa2b-f4969a8d4752 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Copying metadata from image fd686eea-703d-49e3-b3b8-8c5ac4b644ee to b1e35936-830c-40c0-aa2b-f4969a8d4752. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Creating volume glance metadata for volume b1e35936-830c-40c0-aa2b-f4969a8d4752 backed by image fd686eea-703d-49e3-b3b8-8c5ac4b644ee with: {'image_id': 'fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fdc3d0a803b0f594ec713cb0a3e9e420', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:14:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f32e570d-6d58-46e2-bd13-a90ed20ff227 tempest-CreateVolumesFromSnapshotTest-860798762 None] Created volume successfully.
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1ac59b-aa4a-4c7f-9985-c7450a6c3040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e35936-830c-40c0-aa2b-f4969a8d4752', 'volume_size': 1, 'image_id': 'fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fdc3d0a803b0f594ec713cb0a3e9e420', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a8cae81f04d4b7a921816b755febfe2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e5862aa484bb61072eb3e652f52e8f8741aa1b5d52b88b7d29228dd95fe232463781b3cf217e7bb49cfa0fb5e0a19b7c7c3404c5d4055ecf8cd352b142f6e10', 'id': 'fd686eea-703d-49e3-b3b8-8c5ac4b644ee', 'created_at': datetime.datetime(2026, 7, 3, 11, 13, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 13, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fd686eea-703d-49e3-b3b8-8c5ac4b644ee/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273abe2c440>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69316714-7305-4727-a1c3-b6c5e5a6f4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Volume volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 (b1e35936-830c-40c0-aa2b-f4969a8d4752): created successfully
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69316714-7305-4727-a1c3-b6c5e5a6f4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Flow 'volume_create_manager' (feb3bd93-45a7-4559-bb2f-c0454e2499b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:23 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c053dee7-a954-48f4-b06a-3e18c69e0ce7 tempest-VolumeImageDependencyTests-1529378421 None] Created volume successfully.
Jul 03 13:14:23 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632" returned: 0 in 1.035s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:24 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.158s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:24 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Deleted volume successfully.
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Acquiring lock "cinder-b1e35936-830c-40c0-aa2b-f4969a8d4752-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ab69047e-3e9e-498d-a0f6-f20c38125fab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-44ad2170-8c92-4f73-996d-e413a3b91907-delete_volume" released by "delete_volume" :: held 3.587s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:24 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Lock "cinder-b1e35936-830c-40c0-aa2b-f4969a8d4752-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:24 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Acquiring lock "cinder-quobyte-b1e35936-830c-40c0-aa2b-f4969a8d4752" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Lock "cinder-quobyte-b1e35936-830c-40c0-aa2b-f4969a8d4752" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5166def-2922-4cdc-badd-7502c9f36ac0]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:24 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1" returned: 0 in 1.209s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:24 devstack sudo[107684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1
Jul 03 13:14:24 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:24 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752
Jul 03 13:14:24 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:24 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a 1073741824" returned: 0 in 1.333s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:24 devstack sudo[107687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a
Jul 03 13:14:24 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:24 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632" returned: 1 in 1.031s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Downloaded image 66e28fbf-5a96-4007-8673-01fbb6ffdb8f ((None, [{'url': 'file:///opt/stack/data/glance/images/66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'metadata': {}}])) to volume 6b5d5fb6-2b90-4547-9833-a60e5c1fc632 successfully. {{(pid=86763) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Temporary image 66e28fbf-5a96-4007-8673-01fbb6ffdb8f for user 03ac3c09cd434df795b027bd4761a54b is deleted. {{(pid=86763) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG cinder.volume.volume_utils [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Marking volume 6b5d5fb6-2b90-4547-9833-a60e5c1fc632 as bootable. {{(pid=86763) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Copying metadata from image 66e28fbf-5a96-4007-8673-01fbb6ffdb8f to 6b5d5fb6-2b90-4547-9833-a60e5c1fc632. {{(pid=86763) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:14:24 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Creating volume glance metadata for volume 6b5d5fb6-2b90-4547-9833-a60e5c1fc632 backed by image 66e28fbf-5a96-4007-8673-01fbb6ffdb8f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '13a415f95584d6385e35f0ab31fcad03', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86763) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68859f9b-22db-4a82-9c09-2805e78355af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632', 'volume_size': 1, 'image_id': '66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '13a415f95584d6385e35f0ab31fcad03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '709de5c16ab24fcaba940db896829bf2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eac5836b367bcd622189682b47907ff3fb8c252a79e4325fd061f3bd0870cfbefec68b5668c7652f0f8c98e7ae427ff0d013bccf52a5207a02cfc1f195e7cf22', 'id': '66e28fbf-5a96-4007-8673-01fbb6ffdb8f', 'created_at': datetime.datetime(2026, 7, 3, 11, 13, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 13, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66e28fbf-5a96-4007-8673-01fbb6ffdb8f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7273b6131790>}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532d1bb0-cec5-4b12-a1af-da54e98176f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Volume volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 (6b5d5fb6-2b90-4547-9833-a60e5c1fc632): created successfully
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532d1bb0-cec5-4b12-a1af-da54e98176f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Flow 'volume_create_manager' (ab1a69fd-7e45-4f87-a26e-e7b058ccbfbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-970333cc-867c-4d72-810e-b239236aa4d0 tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Created volume successfully.
Jul 03 13:14:25 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c1612301-9ad0-49d5-82cc-8aed6d7caac1" returned: 0 in 0.789s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-c1612301-9ad0-49d5-82cc-8aed6d7caac1" released by "delete_volume" :: held 2.084s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:25 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752" returned: 0 in 0.964s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created reservations ['16b886e9-d635-44ad-a845-dc1850e6b621', '11125bac-f569-4081-a7c7-bb969b92081a', 'b6d2d9bf-f47b-4aad-8012-3225f9ecadc8', '91ef3821-1023-43a7-bce8-0ecf41ef2c08'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:25 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a" returned: 0 in 0.799s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:25 devstack sudo[107695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752
Jul 03 13:14:25 devstack sudo[107697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.301s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:25 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:25 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-138767735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d738098-ae57-4dd3-9e50-268b81c130f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2931df47ec5848dab347a86bd9289d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:12Z,use_quota=True,user_id='7f2b45ad7e9440e182ce54271defaea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Creating volume 0d738098-ae57-4dd3-9e50-268b81c130f1 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:25 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d6c293-2780-469b-8999-e1daaa6f9685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4333ad6f-658c-4758-aa48-024c4341d97a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cde89f-0f97-49ef-ad23-7baf52777d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:25 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1 1073741824
Jul 03 13:14:25 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume volume-4333ad6f-658c-4758-aa48-024c4341d97a (4333ad6f-658c-4758-aa48-024c4341d97a): created successfully
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cde89f-0f97-49ef-ad23-7baf52777d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (061ad4f5-17e6-46f8-8658-14ae026a64d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6c23be0c-2340-4feb-8a21-55680133927b tempest-CreateVolumesFromSnapshotTest-860798762 None] Created volume successfully.
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Acquiring lock "cinder-6b5d5fb6-2b90-4547-9833-a60e5c1fc632-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Lock "cinder-6b5d5fb6-2b90-4547-9833-a60e5c1fc632-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Acquiring lock "cinder-quobyte-6b5d5fb6-2b90-4547-9833-a60e5c1fc632" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Lock "cinder-quobyte-6b5d5fb6-2b90-4547-9833-a60e5c1fc632" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6566f515-1792-40b2-9c71-4fa659afaf9e]: (4, 'raw') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:25 devstack sudo[107702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632
Jul 03 13:14:25 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:26 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752" returned: 1 in 0.925s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:26 devstack sudo[107711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752
Jul 03 13:14:26 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:26 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.844s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Deleted volume successfully.
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b2a4b5c4-a789-4128-8a56-5ec6747ba20d tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-c1612301-9ad0-49d5-82cc-8aed6d7caac1-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-02518051-4009-4bed-9d8f-ca2f27cce766-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-02518051-4009-4bed-9d8f-ca2f27cce766-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "cinder-quobyte-02518051-4009-4bed-9d8f-ca2f27cce766" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-02518051-4009-4bed-9d8f-ca2f27cce766" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:26 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1 1073741824" returned: 0 in 1.118s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d0ca27-b712-4a3c-a26f-cacdbbef90be]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:26 devstack sudo[107717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1
Jul 03 13:14:26 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:26 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632" returned: 0 in 0.955s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:26 devstack sudo[107716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766
Jul 03 13:14:26 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:26 devstack sudo[107719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632
Jul 03 13:14:26 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:27 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b1e35936-830c-40c0-aa2b-f4969a8d4752" returned: 0 in 0.787s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Lock "cinder-quobyte-b1e35936-830c-40c0-aa2b-f4969a8d4752" released by "delete_volume" :: held 2.788s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Created reservations ['f0e0e496-ee11-4ae6-a536-0c09fb20c753', 'e180d022-d1d4-4b6e-9589-4811ab3fc3c0', 'b5825e07-2594-43b5-9b2a-62c0d8ca5792', '68706964-99dc-4e50-85a8-0b2495ed58db'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:27 devstack sudo[107723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:27 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:27 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1" returned: 0 in 0.839s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18d1574-6eb8-4626-ba86-7c1b96b28f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d738098-ae57-4dd3-9e50-268b81c130f1', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:27 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48c28fb-fc2d-4f4c-a3f2-dbac2917cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766" returned: 0 in 0.953s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Volume volume-0d738098-ae57-4dd3-9e50-268b81c130f1 (0d738098-ae57-4dd3-9e50-268b81c130f1): created successfully
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48c28fb-fc2d-4f4c-a3f2-dbac2917cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:27 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766
Jul 03 13:14:27 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Flow 'volume_create_manager' (a599ab1a-c240-4445-a546-f45785ff6bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-308ba1e6-1ca0-4813-a886-f0bc002115ea tempest-CreateVolumesFromSnapshotTest-860798762 None] Created volume successfully.
Jul 03 13:14:27 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632" returned: 1 in 0.994s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632' failed. Not Retrying. {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:27 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632
Jul 03 13:14:27 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-0d738098-ae57-4dd3-9e50-268b81c130f1-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-0d738098-ae57-4dd3-9e50-268b81c130f1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-quobyte-0d738098-ae57-4dd3-9e50-268b81c130f1" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-0d738098-ae57-4dd3-9e50-268b81c130f1" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dc45b2-0c39-42c2-a012-dd468065b29b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:28 devstack sudo[107737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1
Jul 03 13:14:28 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:28 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.095s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:28 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Deleted volume successfully.
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c69ac238-9066-40a0-8bb8-fb68c9e44f10 tempest-VolumeImageDependencyTests-1529378421 None] Lock "cinder-b1e35936-830c-40c0-aa2b-f4969a8d4752-delete_volume" released by "delete_volume" :: held 4.180s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:28 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-02518051-4009-4bed-9d8f-ca2f27cce766" returned: 0 in 0.974s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-quobyte-02518051-4009-4bed-9d8f-ca2f27cce766" released by "delete_volume" :: held 2.001s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Created reservations ['0ccc5f30-797d-4e5f-8b8a-0ec5c9fc9746', '7a3d4049-cd42-443e-9b17-19c06390b907', 'a5e269fd-0707-4c49-a629-be5ac5855961', '76bb21db-2a10-4120-8180-748d4eeda36b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:28 devstack sudo[107742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:28 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:28 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6b5d5fb6-2b90-4547-9833-a60e5c1fc632" returned: 0 in 1.143s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Lock "cinder-quobyte-6b5d5fb6-2b90-4547-9833-a60e5c1fc632" released by "delete_volume" :: held 3.187s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Created reservations ['10701ec9-5d88-4609-8073-f9a7db3afe6b', '9b57f8f4-f1d7-4495-a68f-8ee41af50e2e', 'a6bc1e2c-f44d-4378-8078-4ab8d6fcee85', 'e30eef20-861a-4d3e-89ba-cc2132855ae0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:29 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1" returned: 0 in 1.195s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:29 devstack sudo[107747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1
Jul 03 13:14:29 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:29 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:29 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:29 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.085s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:29 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Deleted volume successfully.
Jul 03 13:14:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c98f5ec9-564e-4fcf-9577-ee60f6afafab tempest-CreateVolumesFromSourceVolumeTest-287252623 None] Lock "cinder-02518051-4009-4bed-9d8f-ca2f27cce766-delete_volume" released by "delete_volume" :: held 3.482s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:30 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0d738098-ae57-4dd3-9e50-268b81c130f1" returned: 0 in 1.170s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-0d738098-ae57-4dd3-9e50-268b81c130f1" released by "delete_volume" :: held 2.435s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:30 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.207s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Deleted volume successfully.
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-044473fe-e6c4-4969-b625-fbf61450503f tempest-VolumeAndVolumeTypeFromImageTest-1638872593 None] Lock "cinder-6b5d5fb6-2b90-4547-9833-a60e5c1fc632-delete_volume" released by "delete_volume" :: held 4.898s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Created reservations ['f634d9be-f7e4-4a47-835c-84df8b526558', '37b69c5b-826b-4b44-80c8-0ddc718b1c40', '1dfc4a6d-331f-4323-b9a9-eee6ae0e2bce', '0abde358-6417-4eb8-aa34-6a08f141651a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:30 devstack sudo[107755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:30 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-4333ad6f-658c-4758-aa48-024c4341d97a-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-4333ad6f-658c-4758-aa48-024c4341d97a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:31 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.814s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:31 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Deleted volume successfully.
Jul 03 13:14:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-quobyte-4333ad6f-658c-4758-aa48-024c4341d97a" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9d27b329-9ad3-4aa7-97d5-cc5d64cc6c1b tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-0d738098-ae57-4dd3-9e50-268b81c130f1-delete_volume" released by "delete_volume" :: held 3.575s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-4333ad6f-658c-4758-aa48-024c4341d97a" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8468de-6412-425a-b46a-dbad046280a6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:31 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a
Jul 03 13:14:31 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:32 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a" returned: 0 in 1.041s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:32 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a
Jul 03 13:14:32 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:33 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4333ad6f-658c-4758-aa48-024c4341d97a" returned: 0 in 0.816s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-4333ad6f-658c-4758-aa48-024c4341d97a" released by "delete_volume" :: held 1.902s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Created reservations ['4f6ab58b-6257-46a8-876e-cb20f91cbe0b', '3356be0c-2bf9-4d9f-89c2-bd26e2f5a811', '469e5db7-159b-4c40-9001-05a6a321dae7', 'b98c239f-2be6-48b5-8dce-28d508d5107c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Flow 'volume_create_manager' (d8f1d013-fb2a-4c04-b78d-5923dca33060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e830bfbf-cae3-4776-b5f6-1f2e701f6cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e830bfbf-cae3-4776-b5f6-1f2e701f6cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-747589934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2553a6f7-ab0d-44ef-85af-cc4912059fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f8ecf95e5749428cec01f0ed7d88a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:33Z,use_quota=True,user_id='71b070cd2e8746129441d10d33ab3120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d0b4e1-e484-4044-9a6c-116755898643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d0b4e1-e484-4044-9a6c-116755898643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e77b1a-f33d-470f-8b4c-9fffb411b00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e77b1a-f33d-470f-8b4c-9fffb411b00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2553a6f7-ab0d-44ef-85af-cc4912059fea', 'volume_name': 'volume-2553a6f7-ab0d-44ef-85af-cc4912059fea', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a6b5ff-5b3a-4393-99f5-59f99dc46742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a6b5ff-5b3a-4393-99f5-59f99dc46742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003bb176-ef1a-49c2-92cd-42efa03bb4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:33 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Volume 2553a6f7-ab0d-44ef-85af-cc4912059fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2553a6f7-ab0d-44ef-85af-cc4912059fea', 'volume_size': 1}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-747589934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2553a6f7-ab0d-44ef-85af-cc4912059fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f8ecf95e5749428cec01f0ed7d88a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:33Z,use_quota=True,user_id='71b070cd2e8746129441d10d33ab3120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Creating volume 2553a6f7-ab0d-44ef-85af-cc4912059fea {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:33 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:33 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea 1073741824
Jul 03 13:14:33 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:33 devstack sudo[107769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:33 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-b2a6b43c-6e0c-4008-868a-b9444dbd16df-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-b2a6b43c-6e0c-4008-868a-b9444dbd16df-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-quobyte-b2a6b43c-6e0c-4008-868a-b9444dbd16df" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-b2a6b43c-6e0c-4008-868a-b9444dbd16df" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8a7496-1102-4d52-84ed-c835a8b6414e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-19194b31-9bc0-4110-becf-4dad6c8345c0 tempest-ProjectAdminTests-851724187 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7313270568848, 'free_capacity_gb': 1775.7313270568848, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86763) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 13:14:34 devstack sudo[107771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df
Jul 03 13:14:34 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:34 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.934s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:34 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Deleted volume successfully.
Jul 03 13:14:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c073c305-2ee4-44f9-9269-e2fed345c0a8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-4333ad6f-658c-4758-aa48-024c4341d97a-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:34 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea 1073741824" returned: 0 in 1.312s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:34 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df" returned: 0 in 1.005s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:35 devstack sudo[107781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df
Jul 03 13:14:35 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:35 devstack sudo[107783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea
Jul 03 13:14:35 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:35 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b2a6b43c-6e0c-4008-868a-b9444dbd16df" returned: 0 in 0.935s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-b2a6b43c-6e0c-4008-868a-b9444dbd16df" released by "delete_volume" :: held 2.005s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:35 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea" returned: 0 in 0.907s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] <== create_volume: return (2323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.326s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003bb176-ef1a-49c2-92cd-42efa03bb4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2553a6f7-ab0d-44ef-85af-cc4912059fea', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab39dbb4-201b-492e-956d-0ea66994ea84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:36 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Volume volume-2553a6f7-ab0d-44ef-85af-cc4912059fea (2553a6f7-ab0d-44ef-85af-cc4912059fea): created successfully
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab39dbb4-201b-492e-956d-0ea66994ea84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Flow 'volume_create_manager' (d8f1d013-fb2a-4c04-b78d-5923dca33060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:36 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fd7eb2a8-9b22-47fc-87b9-67508dff1415 tempest-VolumeDependencyTests-965893159 None] Created volume successfully.
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Created reservations ['3c42d419-fb18-48a5-8326-ed7bab94ebfe', '9be599a7-ec09-4d4e-ac02-c0c6ed6c4a54', '881a18f4-8f86-480d-ad23-fbae8f6f5e18', '94dd74a1-5727-450e-91ae-0407f9601d13'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:36 devstack sudo[107787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:36 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Flow 'volume_create_manager' (8accf678-6f81-4f7e-9579-85d9d4e98f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c868a9bd-b2a1-477c-b7b4-23b761b4ef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c868a9bd-b2a1-477c-b7b4-23b761b4ef03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1818014696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded7b65e-f7ba-4244-bc86-ac2e7a198e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093faadf8f7d4161b1bd16de2fa1d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:37Z,use_quota=True,user_id='cf03dc1ff774440c912532c714b21c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ad306e-0e52-4dca-a3e4-1fc9038cd332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ad306e-0e52-4dca-a3e4-1fc9038cd332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d75f50-e19b-4fbf-abc3-da5f13bbc2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d75f50-e19b-4fbf-abc3-da5f13bbc2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded7b65e-f7ba-4244-bc86-ac2e7a198e52', 'volume_name': 'volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee18045-3960-48cb-840f-c145cdefc643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee18045-3960-48cb-840f-c145cdefc643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe70a45-2137-468d-8a1c-0ea57e599a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:36 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Volume ded7b65e-f7ba-4244-bc86-ac2e7a198e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52', 'volume_size': 1}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1818014696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded7b65e-f7ba-4244-bc86-ac2e7a198e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093faadf8f7d4161b1bd16de2fa1d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:37Z,use_quota=True,user_id='cf03dc1ff774440c912532c714b21c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Creating volume ded7b65e-f7ba-4244-bc86-ac2e7a198e52 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:36 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:36 devstack sudo[107789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52 1073741824
Jul 03 13:14:36 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:37 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.010s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Deleted volume successfully.
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf2581b2-8725-4470-989e-25744d23c056 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-b2a6b43c-6e0c-4008-868a-b9444dbd16df-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-a78da3b5-7ab1-4cd1-9de2-86b659653af8-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-a78da3b5-7ab1-4cd1-9de2-86b659653af8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-quobyte-a78da3b5-7ab1-4cd1-9de2-86b659653af8" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-a78da3b5-7ab1-4cd1-9de2-86b659653af8" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc691740-037c-40b4-970b-b3463a1f8225]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Flow 'volume_create_manager' (9c5662aa-0339-4dfc-abbe-7719de1ee38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:37 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8
Jul 03 13:14:37 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e82930-90f6-4878-93d8-f7347493605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e82930-90f6-4878-93d8-f7347493605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1958545311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668066cf-5e2b-4c05-88b9-42f9592132ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093faadf8f7d4161b1bd16de2fa1d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:38Z,use_quota=True,user_id='cf03dc1ff774440c912532c714b21c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b16a02-cafa-4552-b4d3-d68614560439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b16a02-cafa-4552-b4d3-d68614560439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40288af-21ce-429e-9d3f-42402ad5a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40288af-21ce-429e-9d3f-42402ad5a915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '668066cf-5e2b-4c05-88b9-42f9592132ab', 'volume_name': 'volume-668066cf-5e2b-4c05-88b9-42f9592132ab', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394cc072-99ab-4279-87b0-63647988b4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394cc072-99ab-4279-87b0-63647988b4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33f5bda-369d-4df0-a10f-49be4273d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:37 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Volume 668066cf-5e2b-4c05-88b9-42f9592132ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-668066cf-5e2b-4c05-88b9-42f9592132ab', 'volume_size': 1}
Jul 03 13:14:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Flow 'volume_create_manager' (be54aedf-96b4-402b-96eb-5dc9cfc2c4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e2394b-a8cd-4f0e-a5ee-9e6d9af1d90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e2394b-a8cd-4f0e-a5ee-9e6d9af1d90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1311064340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63133ed-ae75-4f70-9fcc-b15454314725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093faadf8f7d4161b1bd16de2fa1d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:38Z,use_quota=True,user_id='cf03dc1ff774440c912532c714b21c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40d8adb-54f8-46ca-adea-a4ac25b742f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40d8adb-54f8-46ca-adea-a4ac25b742f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba24c8b-b12b-42c6-b87b-1fb5806d9f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba24c8b-b12b-42c6-b87b-1fb5806d9f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63133ed-ae75-4f70-9fcc-b15454314725', 'volume_name': 'volume-b63133ed-ae75-4f70-9fcc-b15454314725', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e69a929-d37a-455f-96e2-55a666fbd7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e69a929-d37a-455f-96e2-55a666fbd7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1b0ab0-d5c6-4911-9732-651ade1c8109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Volume b63133ed-ae75-4f70-9fcc-b15454314725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63133ed-ae75-4f70-9fcc-b15454314725', 'volume_size': 1}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:38 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52 1073741824" returned: 0 in 1.378s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:38 devstack sudo[107798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52
Jul 03 13:14:38 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Flow 'volume_create_manager' (1b9ec565-f983-40e1-ac5f-c2ba4a5d36b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb1f263-22eb-4698-8549-e0dff6427822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:38 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8" returned: 0 in 1.164s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb1f263-22eb-4698-8549-e0dff6427822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1273424491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec30ea6-8abc-4a25-9239-337481813ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093faadf8f7d4161b1bd16de2fa1d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:39Z,use_quota=True,user_id='cf03dc1ff774440c912532c714b21c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e8911e-c7e2-4d49-83c1-033d04a56531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e8911e-c7e2-4d49-83c1-033d04a56531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629557d3-64d5-44e1-9eeb-44ac1c6f3c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629557d3-64d5-44e1-9eeb-44ac1c6f3c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec30ea6-8abc-4a25-9239-337481813ab2', 'volume_name': 'volume-8ec30ea6-8abc-4a25-9239-337481813ab2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:38 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8
Jul 03 13:14:38 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65f04dd-4d1d-4795-a49f-102f8e0bf132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65f04dd-4d1d-4795-a49f-102f8e0bf132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f27f31-e9a2-4556-93aa-1aa9a58d4b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Volume 8ec30ea6-8abc-4a25-9239-337481813ab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec30ea6-8abc-4a25-9239-337481813ab2', 'volume_size': 1}
Jul 03 13:14:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Flow 'volume_create_manager' (39c25174-7d9b-47a5-bed8-8a27b339d92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85019ac-7e49-434c-975b-a26baa3d897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85019ac-7e49-434c-975b-a26baa3d897b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1727771398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d98f763-fb87-4da2-b317-b1299c8677fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093faadf8f7d4161b1bd16de2fa1d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:39Z,use_quota=True,user_id='cf03dc1ff774440c912532c714b21c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3453c6-baf9-40c9-a600-604075e8c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3453c6-baf9-40c9-a600-604075e8c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a90effa-51c6-454a-ad79-bd44418a96c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a90effa-51c6-454a-ad79-bd44418a96c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d98f763-fb87-4da2-b317-b1299c8677fc', 'volume_name': 'volume-1d98f763-fb87-4da2-b317-b1299c8677fc', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394b5a41-15c3-4add-8d9b-b0250dee8517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394b5a41-15c3-4add-8d9b-b0250dee8517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fd4bb7-44e8-425a-a6c7-ca8e6243c807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:39 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Volume 1d98f763-fb87-4da2-b317-b1299c8677fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d98f763-fb87-4da2-b317-b1299c8677fc', 'volume_size': 1}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:39 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52" returned: 0 in 1.053s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] <== create_volume: return (2500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.513s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.573s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] Creating offline snapshot 5fb6a834-9566-4a8b-98a8-bf4fb7102879 of volume 2553a6f7-ab0d-44ef-85af-cc4912059fea {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe70a45-2137-468d-8a1c-0ea57e599a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662ad857-f6c5-4ca6-9f52-ef4516485d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7fde82-5eba-4ee0-9f7d-d557cd632b2f]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:39 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Volume volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52 (ded7b65e-f7ba-4244-bc86-ac2e7a198e52): created successfully
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662ad857-f6c5-4ca6-9f52-ef4516485d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Flow 'volume_create_manager' (8accf678-6f81-4f7e-9579-85d9d4e98f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:39 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-11deab9e-eb03-43b5-8836-be6450c9c42f tempest-CreateVolumesFromImageTest-152074860 None] Created volume successfully.
Jul 03 13:14:39 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a78da3b5-7ab1-4cd1-9de2-86b659653af8" returned: 0 in 0.850s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:39 devstack sudo[107806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea
Jul 03 13:14:39 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-a78da3b5-7ab1-4cd1-9de2-86b659653af8" released by "delete_volume" :: held 2.112s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Created reservations ['d7b09489-65ed-45a6-921f-c2d1764d5082', '0b1920e1-87d1-4246-adfb-7db27f7d01f5', 'a33f546a-1194-4b57-a5ff-c4b01eaa7091', 'f22e975f-b3ff-47c8-9093-a125961e76dc'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:39 devstack sudo[107809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:39 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:40 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea" returned: 0 in 1.063s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:40 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879 1G
Jul 03 13:14:40 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:40 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.909s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:40 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Deleted volume successfully.
Jul 03 13:14:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2b3879c1-00d8-44c6-bb27-7fcd7f0fd30a tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-a78da3b5-7ab1-4cd1-9de2-86b659653af8-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-894055c8-93ef-4efa-8c61-4a5fdf183ac5-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-894055c8-93ef-4efa-8c61-4a5fdf183ac5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:40 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (ddfb9da7-15ae-4fce-b473-85de8eb44139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85d8b43-a084-4de2-8428-c4f5a2fb2fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85d8b43-a084-4de2-8428-c4f5a2fb2fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326086822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc8da03-655a-47e1-a709-9d9849bb40cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:41Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552170fb-d98d-417b-a02b-87852b918a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552170fb-d98d-417b-a02b-87852b918a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333f80bd-c650-4384-b78f-9b345161e58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333f80bd-c650-4384-b78f-9b345161e58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc8da03-655a-47e1-a709-9d9849bb40cd', 'volume_name': 'volume-6dc8da03-655a-47e1-a709-9d9849bb40cd', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aaa3754-5b44-4963-89c6-f46279d61e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aaa3754-5b44-4963-89c6-f46279d61e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433c5c87-8145-462d-83b5-0d321ce1c8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:41 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Volume 6dc8da03-655a-47e1-a709-9d9849bb40cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc8da03-655a-47e1-a709-9d9849bb40cd', 'volume_size': 1}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-quobyte-894055c8-93ef-4efa-8c61-4a5fdf183ac5" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-894055c8-93ef-4efa-8c61-4a5fdf183ac5" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf96a06-76f2-41d6-b406-7fd0520a5c91]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:41 devstack sudo[107818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5
Jul 03 13:14:41 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:41 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879 1G" returned: 0 in 0.986s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2553a6f7-ab0d-44ef-85af-cc4912059fea -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:41 devstack sudo[107823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2553a6f7-ab0d-44ef-85af-cc4912059fea -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879
Jul 03 13:14:41 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:41 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5" returned: 0 in 0.822s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:41 devstack sudo[107828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5
Jul 03 13:14:41 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:42 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2553a6f7-ab0d-44ef-85af-cc4912059fea -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879" returned: 0 in 0.810s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:42 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879 is being set with open permissions: ugo+rw
Jul 03 13:14:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:42 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879
Jul 03 13:14:42 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:42 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-894055c8-93ef-4efa-8c61-4a5fdf183ac5" returned: 0 in 0.638s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-894055c8-93ef-4efa-8c61-4a5fdf183ac5" released by "delete_volume" :: held 1.513s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:42 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Created reservations ['4afd27b4-befd-4adf-bfce-f76d47cd4896', '5337fc81-0327-4182-876f-646b30e81df4', '2c9c087e-b164-4075-bf27-676bd3bebcf9', '75987eee-198e-44f1-8f79-e972475e4dc7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:42 devstack sudo[107836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:42 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:42 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879" returned: 0 in 0.683s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:43 devstack sudo[107839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.info
Jul 03 13:14:43 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-8d87c50b-e733-4c37-af4c-8125ef8a03ca-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-8d87c50b-e733-4c37-af4c-8125ef8a03ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-quobyte-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-quobyte-8d87c50b-e733-4c37-af4c-8125ef8a03ca" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-8d87c50b-e733-4c37-af4c-8125ef8a03ca" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Deleting offline snapshot 8d87c50b-e733-4c37-af4c-8125ef8a03ca of volume ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] snapshot_file for this snap is: volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[84651fcc-c880-49a4-a3a2-8e9a27a5beb1]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:43 devstack sudo[107841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca
Jul 03 13:14:43 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:43 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.868s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Deleted volume successfully.
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-40785b0e-ab82-420c-9499-cf37fb0a1a14 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-894055c8-93ef-4efa-8c61-4a5fdf183ac5-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:43 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.info" returned: 0 in 0.787s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:43 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.info is being set with open permissions: ugo+rw
Jul 03 13:14:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:43 devstack sudo[107845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.info
Jul 03 13:14:43 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:44 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca" returned: 0 in 0.888s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9678d93d-11c2-4935-9b90-08cc7addeecd]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:44 devstack sudo[107850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9
Jul 03 13:14:44 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:44 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.info" returned: 0 in 0.692s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.155s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.650s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1958545311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668066cf-5e2b-4c05-88b9-42f9592132ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093faadf8f7d4161b1bd16de2fa1d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:38Z,use_quota=True,user_id='cf03dc1ff774440c912532c714b21c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Creating volume 668066cf-5e2b-4c05-88b9-42f9592132ab {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:44 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:44 devstack sudo[107853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab 1073741824
Jul 03 13:14:44 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8e42c7c4-d374-4121-9929-bc8d2d2997a0 tempest-VolumeDependencyTests-965893159 None] Create snapshot completed successfully
Jul 03 13:14:44 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9" returned: 0 in 0.800s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:44 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca
Jul 03 13:14:44 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:45 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab 1073741824" returned: 0 in 0.898s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:45 devstack sudo[107863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab
Jul 03 13:14:45 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:45 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca" returned: 0 in 0.800s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:45 devstack sudo[107869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca
Jul 03 13:14:45 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:46 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab" returned: 0 in 0.777s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.120s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1311064340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63133ed-ae75-4f70-9fcc-b15454314725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093faadf8f7d4161b1bd16de2fa1d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:38Z,use_quota=True,user_id='cf03dc1ff774440c912532c714b21c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Creating volume b63133ed-ae75-4f70-9fcc-b15454314725 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:46 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:46 devstack sudo[107872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725 1073741824
Jul 03 13:14:46 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33f5bda-369d-4df0-a10f-49be4273d19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-668066cf-5e2b-4c05-88b9-42f9592132ab', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c805f1-6bd4-402e-9a68-380331e21f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Volume volume-668066cf-5e2b-4c05-88b9-42f9592132ab (668066cf-5e2b-4c05-88b9-42f9592132ab): created successfully
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c805f1-6bd4-402e-9a68-380331e21f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Flow 'volume_create_manager' (9c5662aa-0339-4dfc-abbe-7719de1ee38d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Flow 'volume_create_manager' (ea78fab0-3d8d-47bd-8476-cb8f102880ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c62b98-7f95-4984-89f8-735778e62bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ffbad522-21ae-4b61-9cc9-a3175c122464 tempest-CreateVolumesFromImageTest-152074860 None] Created volume successfully.
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c62b98-7f95-4984-89f8-735778e62bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1863561980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385d1a27-1f93-40e8-8fcf-e17d2ba76f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f8ecf95e5749428cec01f0ed7d88a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5fb6a834-9566-4a8b-98a8-bf4fb7102879,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:46Z,use_quota=True,user_id='71b070cd2e8746129441d10d33ab3120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17aa8f3-cd0a-4640-a329-ca720445ff92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17aa8f3-cd0a-4640-a329-ca720445ff92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0570d32-b0d8-4d62-89b7-d31e31e82e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0570d32-b0d8-4d62-89b7-d31e31e82e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '385d1a27-1f93-40e8-8fcf-e17d2ba76f60', 'volume_name': 'volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60', 'volume_size': 1, 'snapshot_id': '5fb6a834-9566-4a8b-98a8-bf4fb7102879'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb22881a-745d-49fa-8008-018a17216632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb22881a-745d-49fa-8008-018a17216632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f29cbed-db61-465e-b76e-64a6c597253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:46 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Volume 385d1a27-1f93-40e8-8fcf-e17d2ba76f60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60', 'volume_size': 1, 'snapshot_id': '5fb6a834-9566-4a8b-98a8-bf4fb7102879'}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:46 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9.8d87c50b-e733-4c37-af4c-8125ef8a03ca" returned: 0 in 0.749s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-8d87c50b-e733-4c37-af4c-8125ef8a03ca" released by "_delete_snapshot" :: held 3.355s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9" released by "delete_snapshot" :: held 3.384s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Created reservations ['bfc169c8-68f8-4efe-b2d1-437f3c0a7633', '3c065c20-7170-4965-a868-c4067c8a4976', '443f1082-ac98-4a9e-9e4e-235dd53460be', 'd84bec21-b1d3-456f-973b-c6f4e731768f'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:46 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Delete snapshot completed successfully.
Jul 03 13:14:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-77e55192-46b6-4e4b-8d5a-6c6541c14661 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-8d87c50b-e733-4c37-af4c-8125ef8a03ca-delete_snapshot" released by "delete_snapshot" :: held 3.546s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:47 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725 1073741824" returned: 0 in 0.908s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=128,cinder:UPDATE=170,cinder:DELETE=16,cinder:INSERT=53 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:47 devstack sudo[107878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725
Jul 03 13:14:47 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "cinder-quobyte-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0311b998-ab5e-4fa4-bf41-de148e8d772e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:47 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9
Jul 03 13:14:47 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:47 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725" returned: 0 in 0.715s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.129s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1273424491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec30ea6-8abc-4a25-9239-337481813ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093faadf8f7d4161b1bd16de2fa1d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:39Z,use_quota=True,user_id='cf03dc1ff774440c912532c714b21c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Creating volume 8ec30ea6-8abc-4a25-9239-337481813ab2 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:47 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1b0ab0-d5c6-4911-9732-651ade1c8109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63133ed-ae75-4f70-9fcc-b15454314725', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11448935-fb8a-4b2b-8b3d-5fd323c326b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:48 devstack sudo[107883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2 1073741824
Jul 03 13:14:48 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:48 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=132,cinder:UPDATE=173,cinder:INSERT=42,cinder:DELETE=16 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:14:48 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Volume volume-b63133ed-ae75-4f70-9fcc-b15454314725 (b63133ed-ae75-4f70-9fcc-b15454314725): created successfully
Jul 03 13:14:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11448935-fb8a-4b2b-8b3d-5fd323c326b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Flow 'volume_create_manager' (be54aedf-96b4-402b-96eb-5dc9cfc2c4b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:48 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-01682b92-c3c8-4459-8016-503612f9687b tempest-CreateVolumesFromImageTest-152074860 None] Created volume successfully.
Jul 03 13:14:48 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9" returned: 0 in 0.799s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:48 devstack sudo[107888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9
Jul 03 13:14:48 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:48 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2 1073741824" returned: 0 in 0.933s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:48 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2
Jul 03 13:14:48 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:49 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9" returned: 0 in 0.779s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-quobyte-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9" released by "delete_volume" :: held 1.649s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Created reservations ['12528696-0e81-4b90-a73d-5b8b74ae76f5', 'a7cb57ba-7a63-4c94-8ea7-ac1bfded6245', 'c362bf4e-ccab-4e3c-b461-31c304a96590', '4da2a643-5ddf-4d0e-98e9-0f5b4fe499e9'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:49 devstack sudo[107896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:49 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:49 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2" returned: 0 in 0.723s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.408s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1727771398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d98f763-fb87-4da2-b317-b1299c8677fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093faadf8f7d4161b1bd16de2fa1d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:39Z,use_quota=True,user_id='cf03dc1ff774440c912532c714b21c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Creating volume 1d98f763-fb87-4da2-b317-b1299c8677fc {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:49 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f27f31-e9a2-4556-93aa-1aa9a58d4b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec30ea6-8abc-4a25-9239-337481813ab2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:49 devstack sudo[107899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc 1073741824
Jul 03 13:14:49 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59353095-4c8b-4786-8a43-1e3a107d4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:49 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Volume volume-8ec30ea6-8abc-4a25-9239-337481813ab2 (8ec30ea6-8abc-4a25-9239-337481813ab2): created successfully
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59353095-4c8b-4786-8a43-1e3a107d4853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Flow 'volume_create_manager' (1b9ec565-f983-40e1-ac5f-c2ba4a5d36b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:49 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-fee518da-09be-4fc9-98f7-04c701995203 tempest-CreateVolumesFromImageTest-152074860 None] Created volume successfully.
Jul 03 13:14:50 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.758s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:50 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Deleted volume successfully.
Jul 03 13:14:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e86532e4-10f8-4e24-a1e7-7749034408e8 tempest-CreateVolumesFromSnapshotTest-860798762 None] Lock "cinder-ec8ab4bb-e86b-4d27-81e8-79bcb99d94a9-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:50 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc 1073741824" returned: 0 in 1.026s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:50 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc
Jul 03 13:14:50 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:51 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc" returned: 0 in 0.700s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.426s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326086822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc8da03-655a-47e1-a709-9d9849bb40cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:41Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Creating volume 6dc8da03-655a-47e1-a709-9d9849bb40cd {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:51 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fd4bb7-44e8-425a-a6c7-ca8e6243c807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d98f763-fb87-4da2-b317-b1299c8677fc', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f30c11-665b-4186-8c91-66d5b04d03f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:51 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd 1073741824
Jul 03 13:14:51 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:51 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Volume volume-1d98f763-fb87-4da2-b317-b1299c8677fc (1d98f763-fb87-4da2-b317-b1299c8677fc): created successfully
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f30c11-665b-4186-8c91-66d5b04d03f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:51 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Flow 'volume_create_manager' (39c25174-7d9b-47a5-bed8-8a27b339d92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6b6cf5f5-82fe-4d16-a92f-19454f7f9e9c tempest-CreateVolumesFromImageTest-152074860 None] Created volume successfully.
Jul 03 13:14:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "cinder-1d98f763-fb87-4da2-b317-b1299c8677fc-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-1d98f763-fb87-4da2-b317-b1299c8677fc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "cinder-quobyte-1d98f763-fb87-4da2-b317-b1299c8677fc" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-quobyte-1d98f763-fb87-4da2-b317-b1299c8677fc" acquired by "delete_volume" :: waited 0.035s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cab279-a7d1-448a-99ea-38afd24b333b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:52 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd 1073741824" returned: 0 in 1.050s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:52 devstack sudo[107916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc
Jul 03 13:14:52 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:52 devstack sudo[107918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd
Jul 03 13:14:52 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:14:53 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:53 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Flow 'volume_create_manager' (11b2761b-130a-4cb6-925e-00bda0e4943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08881152-6ed2-4d89-a50a-00c221f5106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd" returned: 0 in 0.897s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc" returned: 0 in 1.049s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Acquiring lock "cinder-quobyte-5fb6a834-9566-4a8b-98a8-bf4fb7102879-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08881152-6ed2-4d89-a50a-00c221f5106a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f7906e9f6493a8596c7837bfee46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:53Z,use_quota=True,user_id='76ee766c5471484eb1e617764917e4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:53 devstack sudo[107924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f42aa8-5153-46fd-9091-e08ddc5bf7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:53 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f42aa8-5153-46fd-9091-e08ddc5bf7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa30dfd2-f82a-4f0c-aa8d-aa37875f9e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa30dfd2-f82a-4f0c-aa8d-aa37875f9e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17', 'volume_name': 'volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494abd51-41cd-41b4-bf45-97f8f346d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494abd51-41cd-41b4-bf45-97f8f346d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadcb600-1ea9-42c6-bf94-5f0d4993148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Volume 0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17', 'volume_size': 1}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433c5c87-8145-462d-83b5-0d321ce1c8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc8da03-655a-47e1-a709-9d9849bb40cd', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8de0b2-91ce-453b-9218-bcae4fda983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-5fb6a834-9566-4a8b-98a8-bf4fb7102879-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" acquired by "_create_volume_from_snapshot" :: waited 0.081s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Creating volume 385d1a27-1f93-40e8-8fcf-e17d2ba76f60 from snapshot 5fb6a834-9566-4a8b-98a8-bf4fb7102879 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Acquiring lock "cinder-quobyte-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Volume volume-6dc8da03-655a-47e1-a709-9d9849bb40cd (6dc8da03-655a-47e1-a709-9d9849bb40cd): created successfully
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8de0b2-91ce-453b-9218-bcae4fda983f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (ddfb9da7-15ae-4fce-b473-85de8eb44139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] snapshot: 5fb6a834-9566-4a8b-98a8-bf4fb7102879, volume: 385d1a27-1f93-40e8-8fcf-e17d2ba76f60,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:14:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0b0af634-878d-439a-9d49-d7562f18cb83 tempest-ProjectMemberTests-144615743 None] Created volume successfully.
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[07608d31-bffc-43fe-8fc6-e2384d7a16bc]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:53 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879
Jul 03 13:14:53 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:54 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-1d98f763-fb87-4da2-b317-b1299c8677fc" returned: 0 in 0.817s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-quobyte-1d98f763-fb87-4da2-b317-b1299c8677fc" released by "delete_volume" :: held 1.926s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Created reservations ['6e88ef1e-5ff2-435a-aeae-809cfd06d9a1', '33f7280b-ad07-4b97-839b-6d9aeeb3935b', 'dc5c7823-db3b-4995-8b7b-32b90b3983f0', 'cea77a11-6b9a-425a-b2d2-c9ff19c148af'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:54 devstack sudo[107931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:54 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "cinder-8ec30ea6-8abc-4a25-9239-337481813ab2-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-8ec30ea6-8abc-4a25-9239-337481813ab2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "cinder-quobyte-8ec30ea6-8abc-4a25-9239-337481813ab2" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:54 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879" returned: 0 in 0.985s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2553a6f7-ab0d-44ef-85af-cc4912059fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-quobyte-8ec30ea6-8abc-4a25-9239-337481813ab2" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f91070d-073f-4317-a415-186fdec56cf4]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab290d6-85d3-41a5-9f27-667b9a316684]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:54 devstack sudo[107934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea
Jul 03 13:14:54 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:54 devstack sudo[107935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2
Jul 03 13:14:54 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:55 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.699s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:55 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:55 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Deleted volume successfully.
Jul 03 13:14:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-86acb0e7-a3b9-4696-a773-8b82b31726b5 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-1d98f763-fb87-4da2-b317-b1299c8677fc-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:55 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2" returned: 0 in 0.804s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:55 devstack sudo[107945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2
Jul 03 13:14:55 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:55 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea" returned: 0 in 0.881s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:55 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60 not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 13:14:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:55 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60
Jul 03 13:14:55 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:56 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ec30ea6-8abc-4a25-9239-337481813ab2" returned: 0 in 0.744s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:56 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-quobyte-8ec30ea6-8abc-4a25-9239-337481813ab2" released by "delete_volume" :: held 1.601s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:56 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Created reservations ['0b0a070a-75ab-4cfb-9405-4645718135ad', '74fcf640-3e19-4bdf-b181-9ae7e4b2fbb4', 'd234d8ae-91ae-42b7-a737-ce924d403f44', '2c65f22c-4c40-491d-aaf2-082c2a34844d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:56 devstack sudo[107953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:14:56 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "cinder-b63133ed-ae75-4f70-9fcc-b15454314725-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-b63133ed-ae75-4f70-9fcc-b15454314725-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "cinder-quobyte-b63133ed-ae75-4f70-9fcc-b15454314725" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-quobyte-b63133ed-ae75-4f70-9fcc-b15454314725" acquired by "delete_volume" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[457d25e6-badd-4707-a853-1c3ad83b616a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:57 devstack sudo[107962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725
Jul 03 13:14:57 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:58 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.795s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:58 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:14:58 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Deleted volume successfully.
Jul 03 13:14:58 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-031070a1-b7fa-49a0-9d60-ad8ab06c3bf6 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-8ec30ea6-8abc-4a25-9239-337481813ab2-delete_volume" released by "delete_volume" :: held 3.740s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:59 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725" returned: 0 in 2.259s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:59 devstack sudo[107971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725
Jul 03 13:14:59 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:01 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" returned: 0 in 5.856s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:01 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-b63133ed-ae75-4f70-9fcc-b15454314725" returned: 0 in 1.809s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[95837557-3307-44f7-967a-3e5cca205675]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-quobyte-b63133ed-ae75-4f70-9fcc-b15454314725" released by "delete_volume" :: held 4.171s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Created reservations ['b4bbda2b-a33a-48eb-a27a-b11288a30e5b', '5dca540a-9684-4dec-a5e6-e686cce52244', '692fdc94-c8e3-4a07-959b-d00768d68ac2', '56efdad8-0857-4daf-9154-ae4fb2a67902'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:01 devstack sudo[107977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea
Jul 03 13:15:01 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:01 devstack sudo[107979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:15:01 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "cinder-668066cf-5e2b-4c05-88b9-42f9592132ab-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-668066cf-5e2b-4c05-88b9-42f9592132ab-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "cinder-quobyte-668066cf-5e2b-4c05-88b9-42f9592132ab" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-quobyte-668066cf-5e2b-4c05-88b9-42f9592132ab" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed1c3ff-4808-415f-8aa0-bc369399ef75]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:02 devstack sudo[107984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab
Jul 03 13:15:02 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:02 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.778s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:02 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:15:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Deleted volume successfully.
Jul 03 13:15:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-63a9e26e-6fb0-4fb6-979d-f1901ab1b35f tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-b63133ed-ae75-4f70-9fcc-b15454314725-delete_volume" released by "delete_volume" :: held 5.374s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:02 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea" returned: 0 in 1.101s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:02 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60 {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:15:02 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Converted 1024.00 MB image at 174.77 MB/s
Jul 03 13:15:02 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60 is being set with open permissions: ugo+rw
Jul 03 13:15:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:02 devstack sudo[107990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60
Jul 03 13:15:02 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:03 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab" returned: 0 in 0.910s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:03 devstack sudo[107995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab
Jul 03 13:15:03 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:03 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" returned: 0 in 0.763s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" released by "_copy_volume_from_snapshot" :: held 9.752s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-5fb6a834-9566-4a8b-98a8-bf4fb7102879-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" released by "_create_volume_from_snapshot" :: held 9.803s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.886s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.832s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f7906e9f6493a8596c7837bfee46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:53Z,use_quota=True,user_id='76ee766c5471484eb1e617764917e4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Creating volume 0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:03 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:03 devstack sudo[107998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17 1073741824
Jul 03 13:15:03 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f29cbed-db61-465e-b76e-64a6c597253c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60', 'volume_size': 1, 'snapshot_id': '5fb6a834-9566-4a8b-98a8-bf4fb7102879'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a931c3-d862-4afa-9b20-dfcc1a66a954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Volume volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60 (385d1a27-1f93-40e8-8fcf-e17d2ba76f60): created successfully
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a931c3-d862-4afa-9b20-dfcc1a66a954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Flow 'volume_create_manager' (ea78fab0-3d8d-47bd-8476-cb8f102880ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:03 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-01cdecce-3187-4f03-8314-5404b1df6acf tempest-VolumeDependencyTests-965893159 None] Created volume successfully.
Jul 03 13:15:03 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-668066cf-5e2b-4c05-88b9-42f9592132ab" returned: 0 in 0.836s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-quobyte-668066cf-5e2b-4c05-88b9-42f9592132ab" released by "delete_volume" :: held 1.803s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:03 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Created reservations ['2f82bb0f-cce6-447c-9099-28f5115e7dae', 'f08f4488-9aa0-40b9-b75a-325c316a0c7b', '9b0bd0d6-38af-47de-bb40-caff174329d5', '0655da95-d1e1-40f4-917f-4e54ab9127d7'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Acquiring lock "cinder-5fb6a834-9566-4a8b-98a8-bf4fb7102879-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Lock "cinder-5fb6a834-9566-4a8b-98a8-bf4fb7102879-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Acquiring lock "cinder-quobyte-2553a6f7-ab0d-44ef-85af-cc4912059fea" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-2553a6f7-ab0d-44ef-85af-cc4912059fea" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Acquiring lock "cinder-quobyte-5fb6a834-9566-4a8b-98a8-bf4fb7102879" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-5fb6a834-9566-4a8b-98a8-bf4fb7102879" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Deleting offline snapshot 5fb6a834-9566-4a8b-98a8-bf4fb7102879 of volume 2553a6f7-ab0d-44ef-85af-cc4912059fea {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] snapshot_file for this snap is: volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:15:04 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:15:04 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c654d4d0-16fc-476b-bd4e-0d2161b2aea9]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "cinder-ded7b65e-f7ba-4244-bc86-ac2e7a198e52-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-ded7b65e-f7ba-4244-bc86-ac2e7a198e52-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "cinder-quobyte-ded7b65e-f7ba-4244-bc86-ac2e7a198e52" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:04 devstack sudo[108040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879
Jul 03 13:15:04 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-quobyte-ded7b65e-f7ba-4244-bc86-ac2e7a198e52" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3518301a-dde8-4227-8034-b9d35f789e57]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:04 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17 1073741824" returned: 0 in 1.271s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:04 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52
Jul 03 13:15:04 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:04 devstack sudo[108046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17
Jul 03 13:15:04 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:05 devstack sudo[108049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:15:05 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:05 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.122s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:15:05 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Deleted volume successfully.
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-cd345a2c-146b-43ff-b6de-2ef83f89b850 tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-668066cf-5e2b-4c05-88b9-42f9592132ab-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:05 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879" returned: 0 in 1.430s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2553a6f7-ab0d-44ef-85af-cc4912059fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:15:05 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17" returned: 0 in 0.916s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.325s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef590d-72f8-4a47-9196-ef1f282b3a53]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.397s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:05 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52" returned: 0 in 1.171s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadcb600-1ea9-42c6-bf94-5f0d4993148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a217a38f-9b7a-4ed6-b63b-61add68cf14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:05 devstack sudo[108065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52
Jul 03 13:15:05 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] Creating offline snapshot bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 of volume 6dc8da03-655a-47e1-a709-9d9849bb40cd {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:15:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Volume volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17 (0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17): created successfully
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a217a38f-9b7a-4ed6-b63b-61add68cf14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Flow 'volume_create_manager' (11b2761b-130a-4cb6-925e-00bda0e4943f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28b02bc-a34a-4584-b060-7c312fd7e2df]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:05 devstack sudo[108064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea
Jul 03 13:15:05 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f193f19e-cda8-41f6-bf80-eb5921356565 tempest-CinderUnicodeTest-867066130 None] Created volume successfully.
Jul 03 13:15:05 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:05 devstack sudo[108067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd
Jul 03 13:15:05 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:06 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.993s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:15:06 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ded7b65e-f7ba-4244-bc86-ac2e7a198e52" returned: 0 in 0.875s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:06 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea" returned: 0 in 0.918s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-quobyte-ded7b65e-f7ba-4244-bc86-ac2e7a198e52" released by "delete_volume" :: held 2.128s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:06 devstack sudo[108078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879
Jul 03 13:15:06 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Created reservations ['5494b828-7656-4ebb-b337-7273dc6099b3', '1f65e894-0f89-46cd-8634-d1d37bad0c2a', '8f94093b-f104-409d-8a74-3182de9cb3ce', '81e3c11e-4f81-40eb-bdd1-179c7ce75f53'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:06 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd" returned: 0 in 0.905s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:06 devstack sudo[108080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 1G
Jul 03 13:15:06 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:06 devstack sudo[108082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:15:06 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Flow 'volume_create_manager' (20894e66-612e-4b7d-b152-8c664deff4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953e1e95-e6b7-43fb-904e-40971a3d5cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953e1e95-e6b7-43fb-904e-40971a3d5cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-914537775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be41bf5d-8e7c-42f6-8ae5-0c5a8323d961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f7906e9f6493a8596c7837bfee46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:07Z,use_quota=True,user_id='76ee766c5471484eb1e617764917e4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f497af9-fd54-4c4f-b74a-fcbe34da3b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f497af9-fd54-4c4f-b74a-fcbe34da3b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43970511-3407-4d3d-bca4-8495364d7cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43970511-3407-4d3d-bca4-8495364d7cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be41bf5d-8e7c-42f6-8ae5-0c5a8323d961', 'volume_name': 'volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b501665-605b-4afb-96c9-a56de7175e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b501665-605b-4afb-96c9-a56de7175e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac11463b-91c3-408b-bd3d-cd36612ed661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:07 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Volume be41bf5d-8e7c-42f6-8ae5-0c5a8323d961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961', 'volume_size': 1}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:07 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879" returned: 0 in 1.011s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:07 devstack sudo[108092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879
Jul 03 13:15:07 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:07 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.915s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:15:07 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Deleted volume successfully.
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-42ea4278-2c26-4258-98a8-c3375b40dd0d tempest-CreateVolumesFromImageTest-152074860 None] Lock "cinder-ded7b65e-f7ba-4244-bc86-ac2e7a198e52-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:07 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 1G" returned: 0 in 1.150s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc8da03-655a-47e1-a709-9d9849bb40cd -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:07 devstack sudo[108094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc8da03-655a-47e1-a709-9d9849bb40cd -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344
Jul 03 13:15:07 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:08 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea.5fb6a834-9566-4a8b-98a8-bf4fb7102879" returned: 0 in 0.846s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-5fb6a834-9566-4a8b-98a8-bf4fb7102879" released by "_delete_snapshot" :: held 4.389s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-2553a6f7-ab0d-44ef-85af-cc4912059fea" released by "delete_snapshot" :: held 4.475s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:08 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Created reservations ['fbc5bb7c-4f86-4e8d-9379-18a1f940f66d', 'c1e67b81-e64e-4b7c-a15c-085384858d0e', '53ffec2b-27fa-46f5-a6cf-dd00cff66d8c', '07b5396d-1ca7-4942-b4a3-5432c54eff46'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Delete snapshot completed successfully.
Jul 03 13:15:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6da4899b-aa7f-4b23-91c0-1f98cd82003a tempest-VolumeDependencyTests-965893159 None] Lock "cinder-5fb6a834-9566-4a8b-98a8-bf4fb7102879-delete_snapshot" released by "delete_snapshot" :: held 4.701s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:08 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc8da03-655a-47e1-a709-9d9849bb40cd -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344" returned: 0 in 0.897s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:08 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 is being set with open permissions: ugo+rw
Jul 03 13:15:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:08 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344
Jul 03 13:15:08 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Acquiring lock "cinder-2553a6f7-ab0d-44ef-85af-cc4912059fea-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Lock "cinder-2553a6f7-ab0d-44ef-85af-cc4912059fea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:09 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344" returned: 0 in 0.771s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Acquiring lock "cinder-quobyte-2553a6f7-ab0d-44ef-85af-cc4912059fea" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-2553a6f7-ab0d-44ef-85af-cc4912059fea" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:09 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef83643d-f8c7-470f-b1dd-6b36f2a5e655]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:09 devstack sudo[108103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.info
Jul 03 13:15:09 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:09 devstack sudo[108104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea
Jul 03 13:15:09 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:10 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.info" returned: 0 in 0.735s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:10 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.info is being set with open permissions: ugo+rw
Jul 03 13:15:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:10 devstack sudo[108111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.info
Jul 03 13:15:10 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:10 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea" returned: 0 in 0.842s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:10 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea
Jul 03 13:15:10 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:11 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.info" returned: 0 in 0.774s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.471s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.708s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-914537775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be41bf5d-8e7c-42f6-8ae5-0c5a8323d961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f7906e9f6493a8596c7837bfee46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:07Z,use_quota=True,user_id='76ee766c5471484eb1e617764917e4ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Creating volume be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:11 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:11 devstack sudo[108118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 1073741824
Jul 03 13:15:11 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3f6e9e78-fce0-48c2-967d-01b7269c1e47 tempest-ProjectMemberTests-144615743 None] Create snapshot completed successfully
Jul 03 13:15:11 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-2553a6f7-ab0d-44ef-85af-cc4912059fea" returned: 0 in 0.828s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-2553a6f7-ab0d-44ef-85af-cc4912059fea" released by "delete_volume" :: held 1.752s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Created reservations ['e56dc1b0-6f97-4fe7-816b-7ea6dc13e0cc', '9289d65f-9e14-453b-97cd-ba645b8545fb', 'beca040e-5859-41a4-a2f5-d34d46376ec0', '93de2276-53ad-47a0-aaa9-9c15cfec0d6a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:11 devstack sudo[108120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:15:11 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Acquiring lock "cinder-385d1a27-1f93-40e8-8fcf-e17d2ba76f60-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Lock "cinder-385d1a27-1f93-40e8-8fcf-e17d2ba76f60-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Acquiring lock "cinder-quobyte-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c659cace-19f3-45d7-a13f-0c959d39fa9a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:12 devstack sudo[108122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60
Jul 03 13:15:12 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:12 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 1073741824" returned: 0 in 1.168s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:12 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.875s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:15:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Deleted volume successfully.
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-bc8cea69-3aa8-4dd8-b9fc-6af32b71c344-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Lock "cinder-bc8cea69-3aa8-4dd8-b9fc-6af32b71c344-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-6dc8da03-655a-47e1-a709-9d9849bb40cd" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-6dc8da03-655a-47e1-a709-9d9849bb40cd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-bc8cea69-3aa8-4dd8-b9fc-6af32b71c344" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-bc8cea69-3aa8-4dd8-b9fc-6af32b71c344" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Deleting offline snapshot bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 of volume 6dc8da03-655a-47e1-a709-9d9849bb40cd {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:15:12 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] snapshot_file for this snap is: volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" returned: 0 in 1.000s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d13ae4e-2a9b-4c42-9c4d-b7da2fa59071]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:13 devstack sudo[108132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60
Jul 03 13:15:13 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:13 devstack sudo[108133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344
Jul 03 13:15:13 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:13 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" returned: 0 in 0.730s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Lock "cinder-quobyte-385d1a27-1f93-40e8-8fcf-e17d2ba76f60" released by "delete_volume" :: held 1.783s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:13 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344" returned: 0 in 0.827s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc8da03-655a-47e1-a709-9d9849bb40cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:15:13 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7a0ac615-f539-48fb-b75b-775179dd4771 tempest-VolumeDependencyTests-965893159 None] Lock "cinder-2553a6f7-ab0d-44ef-85af-cc4912059fea-delete_volume" released by "delete_volume" :: held 4.322s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cc8e0e-d803-4709-9239-bb5d9124bf60]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:14 devstack sudo[108140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd
Jul 03 13:15:14 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:14 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd" returned: 0 in 0.804s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:14 devstack sudo[108145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344
Jul 03 13:15:14 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:15 devstack sudo[108147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961
Jul 03 13:15:15 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:15 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344" returned: 0 in 0.747s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:15 devstack sudo[108152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344
Jul 03 13:15:15 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:15 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961" returned: 0 in 0.673s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] <== create_volume: return (4628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:15:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.631s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:16 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd.bc8cea69-3aa8-4dd8-b9fc-6af32b71c344" returned: 0 in 0.667s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-bc8cea69-3aa8-4dd8-b9fc-6af32b71c344" released by "_delete_snapshot" :: held 3.178s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-6dc8da03-655a-47e1-a709-9d9849bb40cd" released by "delete_snapshot" :: held 3.205s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:16 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Created reservations ['368700eb-548e-456f-85ad-2ce88ead5f2a', '61c03569-0c68-4655-8e66-f3564e598982', 'f3496ace-2f4d-451b-9713-87a9f70fc46c', '0ea51ea7-2913-42d1-b1c6-1a969824fcde'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac11463b-91c3-408b-bd3d-cd36612ed661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ff2285-6f90-462a-8d07-4952c08e597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:16 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Created reservations ['c2fd9f45-a729-40ff-a798-2627bfdd5113', '44c735ef-9672-4f6b-94d3-04250f871304', '30ff97b4-e642-4606-b9e0-d769e1530bc2', '43e14e2c-df9d-4c2c-822e-bd098b33dbe0'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:16 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Volume volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 (be41bf5d-8e7c-42f6-8ae5-0c5a8323d961): created successfully
Jul 03 13:15:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ff2285-6f90-462a-8d07-4952c08e597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Flow 'volume_create_manager' (20894e66-612e-4b7d-b152-8c664deff4ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-54c5f433-313f-4578-9330-e755fe5f2b75 tempest-CinderUnicodeTest-867066130 None] Created volume successfully.
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:17 devstack sudo[108156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:15:17 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-6dc8da03-655a-47e1-a709-9d9849bb40cd-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:17 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Delete snapshot completed successfully.
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-10d325a1-0cf7-42e6-9b71-b7b3bc2dd29c tempest-ProjectMemberTests-144615743 None] Lock "cinder-bc8cea69-3aa8-4dd8-b9fc-6af32b71c344-delete_snapshot" released by "delete_snapshot" :: held 4.369s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Lock "cinder-6dc8da03-655a-47e1-a709-9d9849bb40cd-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-6dc8da03-655a-47e1-a709-9d9849bb40cd" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-6dc8da03-655a-47e1-a709-9d9849bb40cd" acquired by "delete_volume" :: waited 0.039s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cec626-e501-4e8f-8031-f73d1a9d1fad]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:17 devstack sudo[108158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd
Jul 03 13:15:17 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] Creating offline snapshot f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad of volume be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:15:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4924939-cb0c-434d-9780-e971fb35759c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:18 devstack sudo[108160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961
Jul 03 13:15:18 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:18 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.222s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:18 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:15:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Deleted volume successfully.
Jul 03 13:15:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4eb3f020-4b2d-4ef1-ae44-803493179de3 tempest-VolumeDependencyTests-965893159 None] Lock "cinder-385d1a27-1f93-40e8-8fcf-e17d2ba76f60-delete_volume" released by "delete_volume" :: held 6.570s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:18 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd" returned: 0 in 1.260s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:18 devstack sudo[108168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd
Jul 03 13:15:18 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:19 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961" returned: 0 in 1.431s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:19 devstack sudo[108173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad 1G
Jul 03 13:15:19 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:19 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6dc8da03-655a-47e1-a709-9d9849bb40cd" returned: 0 in 1.134s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-6dc8da03-655a-47e1-a709-9d9849bb40cd" released by "delete_volume" :: held 2.511s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Created reservations ['7521e780-540a-4a09-9433-3d58ee1b3279', '95a5e70a-316a-404a-9df3-c700fe212ce1', '7a217465-bd11-4f26-ab47-e4d994a91043', '6631feb1-f0e0-4dcc-9117-dee22f11c052'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:20 devstack sudo[108176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:15:20 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:20 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad 1G" returned: 0 in 1.322s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:20 devstack sudo[108182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad
Jul 03 13:15:20 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:21 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.190s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:15:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Deleted volume successfully.
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60935009-d35b-4325-8172-5ed098d8527d tempest-ProjectMemberTests-144615743 None] Lock "cinder-6dc8da03-655a-47e1-a709-9d9849bb40cd-delete_volume" released by "delete_volume" :: held 4.226s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (f0377f41-f168-4964-835d-93b3043d4fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2518b1c7-8fb9-4c70-a331-06b701a86e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2518b1c7-8fb9-4c70-a331-06b701a86e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850103049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e374c2-7202-4544-b568-33722eabc743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:22Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:21 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747a66dd-6236-4015-8b99-5911f4986ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747a66dd-6236-4015-8b99-5911f4986ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abe3404-2e3c-4827-9f93-28eba2dd300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abe3404-2e3c-4827-9f93-28eba2dd300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46e374c2-7202-4544-b568-33722eabc743', 'volume_name': 'volume-46e374c2-7202-4544-b568-33722eabc743', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3afd22-6806-4678-bfd8-6af258bd5813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3afd22-6806-4678-bfd8-6af258bd5813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f6cec4-f2ce-414d-a152-fe7598f28608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:21 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Volume 46e374c2-7202-4544-b568-33722eabc743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46e374c2-7202-4544-b568-33722eabc743', 'volume_size': 1}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad" returned: 0 in 1.042s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:21 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad is being set with open permissions: ugo+rw
Jul 03 13:15:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:21 devstack sudo[108189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad
Jul 03 13:15:21 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:22 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad" returned: 0 in 0.822s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:22 devstack sudo[108192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.info
Jul 03 13:15:22 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:23 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.info" returned: 0 in 0.996s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:23 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.info is being set with open permissions: ugo+rw
Jul 03 13:15:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:23 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.info
Jul 03 13:15:23 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:24 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.info" returned: 0 in 0.890s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.696s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.821s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850103049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e374c2-7202-4544-b568-33722eabc743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:22Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Creating volume 46e374c2-7202-4544-b568-33722eabc743 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:24 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:15:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:24 devstack sudo[108198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743 1073741824
Jul 03 13:15:24 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:24 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6621f12e-dabd-421f-817c-458d4083f06a tempest-CinderUnicodeTest-867066130 None] Create snapshot completed successfully
Jul 03 13:15:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Acquiring lock "cinder-f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Lock "cinder-f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Acquiring lock "cinder-quobyte-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Lock "cinder-quobyte-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Acquiring lock "cinder-quobyte-f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Lock "cinder-quobyte-f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Deleting offline snapshot f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad of volume be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:15:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] snapshot_file for this snap is: volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:15:25 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd15084e-3081-41f4-9857-ffbd908d049e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:25 devstack sudo[108200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad
Jul 03 13:15:25 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:26 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743 1073741824" returned: 0 in 1.688s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:26 devstack sudo[108206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743
Jul 03 13:15:26 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:26 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad" returned: 0 in 1.087s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:15:26 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[86094a4f-014e-415e-9880-2e8aeb0b1283]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:27 devstack sudo[108211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961
Jul 03 13:15:27 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:27 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743" returned: 0 in 0.934s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] <== create_volume: return (2693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:15:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.701s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f6cec4-f2ce-414d-a152-fe7598f28608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e374c2-7202-4544-b568-33722eabc743', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882ebe6d-1a0f-4339-81ed-0cce01931acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Volume volume-46e374c2-7202-4544-b568-33722eabc743 (46e374c2-7202-4544-b568-33722eabc743): created successfully
Jul 03 13:15:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882ebe6d-1a0f-4339-81ed-0cce01931acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (f0377f41-f168-4964-835d-93b3043d4fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-42463aa1-ddff-4e82-9feb-e642b813da5c tempest-ProjectMemberTests-144615743 None] Created volume successfully.
Jul 03 13:15:28 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961" returned: 0 in 1.174s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:28 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad
Jul 03 13:15:28 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] Creating offline snapshot e2c36be1-652d-4ca2-be0a-ef33aeff375c of volume 46e374c2-7202-4544-b568-33722eabc743 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:15:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0eac89-f3f0-4739-960d-a9aa3d3d6a85]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:28 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743
Jul 03 13:15:28 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:29 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad" returned: 0 in 1.265s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:29 devstack sudo[108224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad
Jul 03 13:15:29 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:29 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743" returned: 0 in 1.017s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:29 devstack sudo[108229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c 1G
Jul 03 13:15:29 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:30 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961.f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad" returned: 0 in 0.998s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Lock "cinder-quobyte-f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad" released by "_delete_snapshot" :: held 4.696s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Lock "cinder-quobyte-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961" released by "delete_snapshot" :: held 4.748s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Created reservations ['666567d5-8405-454a-aebf-7aa2ec9b0dc0', 'fc24d495-7404-4e6f-9cd6-e1ddbe88046b', 'ad8615e8-837c-4de1-982b-4e11768db48f', '7e656111-25a4-4eaf-ac28-76af111c3c46'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Delete snapshot completed successfully.
Jul 03 13:15:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-c9a813bb-a666-459b-8bcd-9d1d6fd83b68 tempest-CinderUnicodeTest-867066130 None] Lock "cinder-f89dc8b3-a8a0-4fbf-9f8d-30d29c1255ad-delete_snapshot" released by "delete_snapshot" :: held 5.009s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:30 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c 1G" returned: 0 in 1.066s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46e374c2-7202-4544-b568-33722eabc743 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:30 devstack sudo[108236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46e374c2-7202-4544-b568-33722eabc743 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c
Jul 03 13:15:30 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Acquiring lock "cinder-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Lock "cinder-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Acquiring lock "cinder-quobyte-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Lock "cinder-quobyte-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ab9be3-0313-4162-af53-fed2f25df6f6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:31 devstack sudo[108240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961
Jul 03 13:15:31 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:31 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46e374c2-7202-4544-b568-33722eabc743 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c" returned: 0 in 1.008s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:31 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c is being set with open permissions: ugo+rw
Jul 03 13:15:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:31 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c
Jul 03 13:15:31 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:32 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961" returned: 0 in 1.129s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:32 devstack sudo[108252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961
Jul 03 13:15:32 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:32 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c" returned: 0 in 0.890s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:32 devstack sudo[108255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.info
Jul 03 13:15:32 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (6846f3b4-e979-40ea-8379-339fbf4c24c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d1ddb2-31c3-4323-adb6-7812046de92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d1ddb2-31c3-4323-adb6-7812046de92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324899970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da23061-ac89-44fe-b5c8-3b7abf176e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:33Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba11d34-0e68-41cd-918b-456c7d4d047e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba11d34-0e68-41cd-918b-456c7d4d047e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df52e08f-d95d-4069-976b-d2daf42b5454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df52e08f-d95d-4069-976b-d2daf42b5454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da23061-ac89-44fe-b5c8-3b7abf176e23', 'volume_name': 'volume-6da23061-ac89-44fe-b5c8-3b7abf176e23', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb85daa9-38ed-4ded-9623-310ded7527c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb85daa9-38ed-4ded-9623-310ded7527c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883a82d7-e405-4c63-abee-d805811b75fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:32 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Volume 6da23061-ac89-44fe-b5c8-3b7abf176e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da23061-ac89-44fe-b5c8-3b7abf176e23', 'volume_size': 1}
Jul 03 13:15:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:33 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961" returned: 0 in 1.002s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Lock "cinder-quobyte-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961" released by "delete_volume" :: held 2.229s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:33 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Created reservations ['0b4fef77-df0a-41f0-940f-f60b9ab7db93', 'f36795ce-cf3c-4e2e-9ee3-020f0ad3212b', 'bd877a07-5ba0-4e95-9d5f-24ae6edaf4b0', '7bcffdcc-c185-4826-96f8-cd8f56dfbb0a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:33 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.info" returned: 0 in 0.875s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:33 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.info is being set with open permissions: ugo+rw
Jul 03 13:15:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:33 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.info
Jul 03 13:15:33 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:33 devstack sudo[108261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:15:33 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:34 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.info" returned: 0 in 0.798s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:34 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.809s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.442s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324899970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da23061-ac89-44fe-b5c8-3b7abf176e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:33Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Creating volume 6da23061-ac89-44fe-b5c8-3b7abf176e23 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:34 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.813s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:15:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Deleted volume successfully.
Jul 03 13:15:34 devstack sudo[108265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 1073741824
Jul 03 13:15:34 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8f71e77d-e789-481f-a679-a0bce9511045 tempest-ProjectMemberTests-144615743 None] Create snapshot completed successfully
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8f771627-1d44-4162-a4cc-6431ef5c9e08 tempest-CinderUnicodeTest-867066130 None] Lock "cinder-be41bf5d-8e7c-42f6-8ae5-0c5a8323d961-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Acquiring lock "cinder-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Lock "cinder-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Acquiring lock "cinder-quobyte-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Lock "cinder-quobyte-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eabd526-ea8e-485c-bf22-6ae065b71c24]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-e2c36be1-652d-4ca2-be0a-ef33aeff375c-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:34 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17
Jul 03 13:15:34 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Lock "cinder-e2c36be1-652d-4ca2-be0a-ef33aeff375c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:34 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-46e374c2-7202-4544-b568-33722eabc743" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-46e374c2-7202-4544-b568-33722eabc743" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-e2c36be1-652d-4ca2-be0a-ef33aeff375c" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:35 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-e2c36be1-652d-4ca2-be0a-ef33aeff375c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Deleting offline snapshot e2c36be1-652d-4ca2-be0a-ef33aeff375c of volume 46e374c2-7202-4544-b568-33722eabc743 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:15:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] snapshot_file for this snap is: volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:15:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8163303c-59cb-430c-9f2c-40795e2f89f9]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:35 devstack sudo[108269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c
Jul 03 13:15:35 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:35 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 1073741824" returned: 0 in 1.534s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:36 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17" returned: 0 in 1.251s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:36 devstack sudo[108278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17
Jul 03 13:15:36 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:36 devstack sudo[108281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23
Jul 03 13:15:36 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:36 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c" returned: 0 in 1.355s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:36 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46e374c2-7202-4544-b568-33722eabc743(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:15:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53896db-def6-4062-9ec3-d30a8d367037]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:36 devstack sudo[108285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743
Jul 03 13:15:36 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:36 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17" returned: 0 in 0.895s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Lock "cinder-quobyte-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17" released by "delete_volume" :: held 2.255s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Created reservations ['2918647e-9fb4-480c-92c0-683f6e7418c7', '9004423e-85f4-4db5-b484-5e810524d216', 'ab6d2f4f-bca6-4440-b0ca-839baec6ce62', 'd6d1f112-cb6b-48f6-b465-dff365034534'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:37 devstack sudo[108289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:15:37 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:37 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23" returned: 0 in 1.156s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] <== create_volume: return (2814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.821s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883a82d7-e405-4c63-abee-d805811b75fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da23061-ac89-44fe-b5c8-3b7abf176e23', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0609354e-e611-42b7-8b39-e300afc4edea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:37 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Volume volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 (6da23061-ac89-44fe-b5c8-3b7abf176e23): created successfully
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0609354e-e611-42b7-8b39-e300afc4edea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (6846f3b4-e979-40ea-8379-339fbf4c24c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ad597b4e-72cf-436c-802b-5f73bc542388 tempest-ProjectReaderTests-563782695 None] Created volume successfully.
Jul 03 13:15:37 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743" returned: 0 in 1.127s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:37 devstack sudo[108295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c
Jul 03 13:15:37 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:38 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.836s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:38 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:15:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Deleted volume successfully.
Jul 03 13:15:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed15df34-9c1e-4842-9b04-70642f62473a tempest-CinderUnicodeTest-867066130 None] Lock "cinder-0a8c8709-ae01-4a24-a6c6-67a3ac7b8d17-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] Creating offline snapshot 45746b9d-4314-43f1-afe7-7dae379a6250 of volume 6da23061-ac89-44fe-b5c8-3b7abf176e23 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:15:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d9a534-d5e4-457e-bd83-f521959d1e75]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:38 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c" returned: 0 in 1.063s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:38 devstack sudo[108302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c
Jul 03 13:15:38 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:38 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23
Jul 03 13:15:38 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:39 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743.e2c36be1-652d-4ca2-be0a-ef33aeff375c" returned: 0 in 1.091s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-e2c36be1-652d-4ca2-be0a-ef33aeff375c" released by "_delete_snapshot" :: held 4.792s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-46e374c2-7202-4544-b568-33722eabc743" released by "delete_snapshot" :: held 4.827s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:39 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23" returned: 0 in 1.283s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:39 devstack sudo[108309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250 1G
Jul 03 13:15:39 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Created reservations ['5493b190-704d-45e1-bcda-6ddaafe07325', 'fb83fd47-a17e-407c-b645-d5cc7d172683', '529070eb-cf9f-4e6d-91c3-c8bb5a90721f', '9dd22f3a-4f79-49c3-8cb1-f48be590351a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Delete snapshot completed successfully.
Jul 03 13:15:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-48d22daa-ebb7-40bd-99e1-c03df0644a8a tempest-ProjectMemberTests-144615743 None] Lock "cinder-e2c36be1-652d-4ca2-be0a-ef33aeff375c-delete_snapshot" released by "delete_snapshot" :: held 5.198s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-46e374c2-7202-4544-b568-33722eabc743-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Lock "cinder-46e374c2-7202-4544-b568-33722eabc743-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-46e374c2-7202-4544-b568-33722eabc743" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-46e374c2-7202-4544-b568-33722eabc743" acquired by "delete_volume" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:40 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610f644-3437-4d31-b955-51bfbbd3203c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:40 devstack sudo[108311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743
Jul 03 13:15:40 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:41 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250 1G" returned: 0 in 1.423s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:41 devstack sudo[108319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250
Jul 03 13:15:41 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:41 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743" returned: 0 in 1.063s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:41 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743
Jul 03 13:15:41 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:42 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250" returned: 0 in 0.924s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:42 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250 is being set with open permissions: ugo+rw
Jul 03 13:15:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:42 devstack sudo[108330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250
Jul 03 13:15:42 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:42 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-46e374c2-7202-4544-b568-33722eabc743" returned: 0 in 0.962s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-46e374c2-7202-4544-b568-33722eabc743" released by "delete_volume" :: held 2.114s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:42 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Created reservations ['944681af-1e4d-43e3-b217-656f95e5cdde', 'c2c80562-351a-40be-8b0b-94bf71239927', '87b5103e-4482-43ec-a6f7-9a9011a595bb', 'cdff7e05-114f-4e8b-aaef-356385ff711b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:43 devstack sudo[108334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:15:43 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:43 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250" returned: 0 in 1.003s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:43 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.info
Jul 03 13:15:43 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:44 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.015s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:15:44 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Deleted volume successfully.
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a8055d27-c1a1-46a7-b852-6eff057e67e5 tempest-ProjectMemberTests-144615743 None] Lock "cinder-46e374c2-7202-4544-b568-33722eabc743-delete_volume" released by "delete_volume" :: held 3.571s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:44 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.info" returned: 0 in 0.999s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:44 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.info is being set with open permissions: ugo+rw
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:44 devstack sudo[108340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.info
Jul 03 13:15:44 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (9a444766-414d-41a4-b0e1-b8476c95d4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c998e1-4536-4214-8f5e-da7ab42dfc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c998e1-4536-4214-8f5e-da7ab42dfc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1348703770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8776ad1-1488-445c-b908-febfe5dcbaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:45Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a11a783-9ff1-41aa-bb23-c4133118d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a11a783-9ff1-41aa-bb23-c4133118d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3624688-8ed7-455c-b4e4-caa097da8263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3624688-8ed7-455c-b4e4-caa097da8263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8776ad1-1488-445c-b908-febfe5dcbaf3', 'volume_name': 'volume-f8776ad1-1488-445c-b908-febfe5dcbaf3', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feef43bf-53f0-4d93-8039-35ad1714b607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feef43bf-53f0-4d93-8039-35ad1714b607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875b59a5-fde3-4408-ad32-49e5b628aede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:44 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Volume f8776ad1-1488-445c-b908-febfe5dcbaf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8776ad1-1488-445c-b908-febfe5dcbaf3', 'volume_size': 1}
Jul 03 13:15:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:45 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.info" returned: 0 in 1.041s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.777s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1348703770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8776ad1-1488-445c-b908-febfe5dcbaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:45Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Creating volume f8776ad1-1488-445c-b908-febfe5dcbaf3 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:45 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:45 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 1073741824
Jul 03 13:15:45 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Flow 'volume_create_manager' (9bbae2e5-d3c0-4b73-8ce8-a3e2a9cf15f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54886dd7-7204-4918-b28c-ad8d47b5ed52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-14e6f087-3516-4ead-ba06-3e93f58a7142 tempest-ProjectReaderTests-563782695 None] Create snapshot completed successfully
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54886dd7-7204-4918-b28c-ad8d47b5ed52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1656228595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595c1610-f9e5-4b14-8f9e-82d86133e24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0692d9008e7446f38c6806316aa4c567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:45Z,use_quota=True,user_id='3099f33b3ff247d980c185ab5de10e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff757b99-0a8c-4e39-ab49-71c3e1ddf961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff757b99-0a8c-4e39-ab49-71c3e1ddf961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4c0d8c-3688-4838-af3b-a0a61fcaf6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4c0d8c-3688-4838-af3b-a0a61fcaf6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595c1610-f9e5-4b14-8f9e-82d86133e24f', 'volume_name': 'volume-595c1610-f9e5-4b14-8f9e-82d86133e24f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4db5d3-abdf-4dd4-a760-c4add0a0b3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4db5d3-abdf-4dd4-a760-c4add0a0b3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1fc12a-8acb-47ff-b79e-63c075a18540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:45 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Volume 595c1610-f9e5-4b14-8f9e-82d86133e24f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595c1610-f9e5-4b14-8f9e-82d86133e24f', 'volume_size': 1}
Jul 03 13:15:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-45746b9d-4314-43f1-afe7-7dae379a6250-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Lock "cinder-45746b9d-4314-43f1-afe7-7dae379a6250-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-6da23061-ac89-44fe-b5c8-3b7abf176e23" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-6da23061-ac89-44fe-b5c8-3b7abf176e23" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-45746b9d-4314-43f1-afe7-7dae379a6250" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-45746b9d-4314-43f1-afe7-7dae379a6250" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Deleting offline snapshot 45746b9d-4314-43f1-afe7-7dae379a6250 of volume 6da23061-ac89-44fe-b5c8-3b7abf176e23 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:15:46 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] snapshot_file for this snap is: volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 1073741824" returned: 0 in 1.234s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[742fbb88-ca47-4d98-8465-60cee013b353]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:46 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3
Jul 03 13:15:46 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:46 devstack sudo[108350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250
Jul 03 13:15:46 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:47 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3" returned: 0 in 0.893s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] <== create_volume: return (2194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.035s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1656228595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595c1610-f9e5-4b14-8f9e-82d86133e24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0692d9008e7446f38c6806316aa4c567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:45Z,use_quota=True,user_id='3099f33b3ff247d980c185ab5de10e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Creating volume 595c1610-f9e5-4b14-8f9e-82d86133e24f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:47 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:47 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250" returned: 0 in 0.989s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da23061-ac89-44fe-b5c8-3b7abf176e23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:15:47 devstack sudo[108358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f 1073741824
Jul 03 13:15:47 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875b59a5-fde3-4408-ad32-49e5b628aede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8776ad1-1488-445c-b908-febfe5dcbaf3', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b5ece6-d46e-4881-a094-b66c0bdca779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=102,cinder:UPDATE=150,cinder:DELETE=13,cinder:INSERT=38 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8a6edb-c072-41f2-a826-8a98da612ecd]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:47 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Volume volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 (f8776ad1-1488-445c-b908-febfe5dcbaf3): created successfully
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b5ece6-d46e-4881-a094-b66c0bdca779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:47 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (9a444766-414d-41a4-b0e1-b8476c95d4e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-863479c8-5f8d-4441-b070-f7611b7510da tempest-ProjectMemberTests-144615743 None] Created volume successfully.
Jul 03 13:15:47 devstack sudo[108360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23
Jul 03 13:15:47 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:48 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=116,cinder:INSERT=38,cinder:UPDATE=149,cinder:DELETE=13 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:15:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:48 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f 1073741824" returned: 0 in 1.022s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:48 devstack sudo[108370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f
Jul 03 13:15:48 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:48 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23" returned: 0 in 1.032s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:48 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250
Jul 03 13:15:48 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:49 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f" returned: 0 in 0.804s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.957s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1fc12a-8acb-47ff-b79e-63c075a18540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595c1610-f9e5-4b14-8f9e-82d86133e24f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7674cc3-3d31-4e79-88e5-0d22615164da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] Creating offline snapshot 1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d of volume f8776ad1-1488-445c-b908-febfe5dcbaf3 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:15:49 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Volume volume-595c1610-f9e5-4b14-8f9e-82d86133e24f (595c1610-f9e5-4b14-8f9e-82d86133e24f): created successfully
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7674cc3-3d31-4e79-88e5-0d22615164da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Flow 'volume_create_manager' (9bbae2e5-d3c0-4b73-8ce8-a3e2a9cf15f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52b5902-b4f0-48aa-9477-d9dcc2f3c3be]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:49 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-57edc5d7-1a32-48c1-8f7e-f4a435c530f4 tempest-SnapshotDependencyTests-1806513305 None] Created volume successfully.
Jul 03 13:15:49 devstack sudo[108378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3
Jul 03 13:15:49 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:49 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250" returned: 0 in 1.040s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:49 devstack sudo[108380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250
Jul 03 13:15:49 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:50 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:50 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23.45746b9d-4314-43f1-afe7-7dae379a6250" returned: 0 in 0.734s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3" returned: 0 in 0.976s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-45746b9d-4314-43f1-afe7-7dae379a6250" released by "_delete_snapshot" :: held 3.945s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:50 devstack sudo[108386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d 1G
Jul 03 13:15:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-6da23061-ac89-44fe-b5c8-3b7abf176e23" released by "delete_snapshot" :: held 3.975s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:50 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:50 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Created reservations ['48defe3c-1539-442c-ab93-4b3698bfe6c3', 'ea423034-3edd-4a68-99ef-2087e8241c25', '34eb09e8-c9bc-4a79-a03f-8bd95480efad', '86fbcf04-26ff-4281-a254-326eb666dd36'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Delete snapshot completed successfully.
Jul 03 13:15:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed06870d-c649-49ed-a1da-8fc8d40c9ed6 tempest-ProjectReaderTests-563782695 None] Lock "cinder-45746b9d-4314-43f1-afe7-7dae379a6250-delete_snapshot" released by "delete_snapshot" :: held 4.191s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-6da23061-ac89-44fe-b5c8-3b7abf176e23-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Lock "cinder-6da23061-ac89-44fe-b5c8-3b7abf176e23-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-6da23061-ac89-44fe-b5c8-3b7abf176e23" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-6da23061-ac89-44fe-b5c8-3b7abf176e23" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:51 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbd2fd8-50c7-4ba6-bb38-6dc3d5f1eed4]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:51 devstack sudo[108389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23
Jul 03 13:15:51 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:51 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d 1G" returned: 0 in 1.068s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:51 devstack sudo[108395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d
Jul 03 13:15:51 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:51 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23" returned: 0 in 0.897s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:51 devstack sudo[108400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23
Jul 03 13:15:51 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:52 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d" returned: 0 in 0.908s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:52 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d is being set with open permissions: ugo+rw
Jul 03 13:15:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:52 devstack sudo[108405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d
Jul 03 13:15:52 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:52 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-6da23061-ac89-44fe-b5c8-3b7abf176e23" returned: 0 in 0.853s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-6da23061-ac89-44fe-b5c8-3b7abf176e23" released by "delete_volume" :: held 1.837s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:52 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Created reservations ['82fbd486-9437-4d15-a2ad-e3ecdcef5994', 'c2abeb86-3124-4230-99da-adf05963d276', '6499703f-c944-451a-afeb-b9e58e136d35', 'd42ae999-11ca-4dc5-b2d9-a6b3b6dab107'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:52 devstack sudo[108408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:15:52 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:53 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d" returned: 0 in 0.831s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:53 devstack sudo[108411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.info
Jul 03 13:15:53 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (a79597a7-9782-4663-a05b-8443de6233f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:53 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e88b02-8a93-436b-a4a2-f3e2fe744da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.913s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:15:53 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Deleted volume successfully.
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e88b02-8a93-436b-a4a2-f3e2fe744da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998355924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c476d708-4fd0-499e-b090-8bb4382831c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:54Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ade09ba-772e-4953-860f-6af11289bb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ade09ba-772e-4953-860f-6af11289bb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05bf1d8-d1fa-4fd1-b0bf-3c2be080c493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05bf1d8-d1fa-4fd1-b0bf-3c2be080c493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c476d708-4fd0-499e-b090-8bb4382831c7', 'volume_name': 'volume-c476d708-4fd0-499e-b090-8bb4382831c7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fac634-ca73-44e6-83bb-2fa45cd93091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fac634-ca73-44e6-83bb-2fa45cd93091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d95522-eacd-43bc-b2f6-0be535e95ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:53 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Volume c476d708-4fd0-499e-b090-8bb4382831c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c476d708-4fd0-499e-b090-8bb4382831c7', 'volume_size': 1}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:53 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a1092a97-9109-44c1-8bce-612e96dba347 tempest-ProjectReaderTests-563782695 None] Lock "cinder-6da23061-ac89-44fe-b5c8-3b7abf176e23-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:54 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.info" returned: 0 in 0.866s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:54 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.info is being set with open permissions: ugo+rw
Jul 03 13:15:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:54 devstack sudo[108415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.info
Jul 03 13:15:54 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:54 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.info" returned: 0 in 0.683s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.469s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.768s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] Creating offline snapshot 939e62a0-d38d-49eb-971b-3f10b6096271 of volume 595c1610-f9e5-4b14-8f9e-82d86133e24f {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:15:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7e02cd06-7d8e-407b-a7ce-251b929188d1 tempest-ProjectMemberTests-144615743 None] Create snapshot completed successfully
Jul 03 13:15:54 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[96173874-7c39-4584-ae50-a306796361f9]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:55 devstack sudo[108418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f
Jul 03 13:15:55 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:55 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f" returned: 0 in 0.838s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:55 devstack sudo[108423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271 1G
Jul 03 13:15:55 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Lock "cinder-1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-f8776ad1-1488-445c-b908-febfe5dcbaf3" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-f8776ad1-1488-445c-b908-febfe5dcbaf3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Deleting offline snapshot 1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d of volume f8776ad1-1488-445c-b908-febfe5dcbaf3 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] snapshot_file for this snap is: volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b4e1c2-55e5-4a3a-9ef5-824ec5256e59]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:56 devstack sudo[108425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d
Jul 03 13:15:56 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:56 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271 1G" returned: 0 in 0.905s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595c1610-f9e5-4b14-8f9e-82d86133e24f -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:56 devstack sudo[108434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595c1610-f9e5-4b14-8f9e-82d86133e24f -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271
Jul 03 13:15:56 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:56 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d" returned: 0 in 0.868s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8776ad1-1488-445c-b908-febfe5dcbaf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:15:56 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[97699272-00c4-4ae5-8ed0-16e9b7d31e15]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:56 devstack sudo[108436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3
Jul 03 13:15:56 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:57 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595c1610-f9e5-4b14-8f9e-82d86133e24f -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271" returned: 0 in 0.747s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:57 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271 is being set with open permissions: ugo+rw
Jul 03 13:15:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:57 devstack sudo[108442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271
Jul 03 13:15:57 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:57 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3" returned: 0 in 0.826s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:57 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d
Jul 03 13:15:57 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:58 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271" returned: 0 in 0.849s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:58 devstack sudo[108450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.info
Jul 03 13:15:58 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:58 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d" returned: 0 in 0.953s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:58 devstack sudo[108455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d
Jul 03 13:15:58 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:59 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.info" returned: 0 in 0.764s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:59 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.info is being set with open permissions: ugo+rw
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:59 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.info
Jul 03 13:15:59 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:59 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3.1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d" returned: 0 in 0.708s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d" released by "_delete_snapshot" :: held 3.485s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-f8776ad1-1488-445c-b908-febfe5dcbaf3" released by "delete_snapshot" :: held 3.513s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Created reservations ['9bf68c7d-6bfd-4b67-8b76-c9589fb355b9', '7e10c254-5699-4302-9631-adb075c4a5f4', 'ad80e64f-67ee-46e7-9073-652194d6fc1c', '21ae4d49-be5d-4c2c-b0a6-97c68c815eb5'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Delete snapshot completed successfully.
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-b7ec7e1b-054f-4162-9531-f18614064649 tempest-ProjectMemberTests-144615743 None] Lock "cinder-1d2e5603-74ff-4ec7-989c-5ff4a7eb7c6d-delete_snapshot" released by "delete_snapshot" :: held 3.669s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:59 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.info" returned: 0 in 0.713s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.944s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.896s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998355924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c476d708-4fd0-499e-b090-8bb4382831c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:54Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Creating volume c476d708-4fd0-499e-b090-8bb4382831c7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:59 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:15:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:59 devstack sudo[108464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7 1073741824
Jul 03 13:15:59 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-894d3693-ad70-4f91-9755-f53cd086eded tempest-SnapshotDependencyTests-1806513305 None] Create snapshot completed successfully
Jul 03 13:16:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-f8776ad1-1488-445c-b908-febfe5dcbaf3-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Lock "cinder-f8776ad1-1488-445c-b908-febfe5dcbaf3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-f8776ad1-1488-445c-b908-febfe5dcbaf3" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:00 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-f8776ad1-1488-445c-b908-febfe5dcbaf3" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:00 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa066ff-be38-4b4d-a2c7-459b06f4c8cf]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:00 devstack sudo[108466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3
Jul 03 13:16:00 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:00 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7 1073741824" returned: 0 in 0.962s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:00 devstack sudo[108471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7
Jul 03 13:16:00 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:16:01 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3" returned: 0 in 0.961s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:01 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3
Jul 03 13:16:01 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Flow 'volume_create_manager' (989d9a22-57bb-4cf6-ab75-0de2b16edbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d1378d-1b7f-49c7-bb01-834841a665df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d1378d-1b7f-49c7-bb01-834841a665df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b96c18-611b-442b-ac29-0decddb02bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0692d9008e7446f38c6806316aa4c567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=939e62a0-d38d-49eb-971b-3f10b6096271,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:01Z,use_quota=True,user_id='3099f33b3ff247d980c185ab5de10e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18753652-9f4f-4d70-bde8-907b6583f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18753652-9f4f-4d70-bde8-907b6583f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e1ec52-c130-4417-8cd6-30e7375854e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e1ec52-c130-4417-8cd6-30e7375854e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84b96c18-611b-442b-ac29-0decddb02bbc', 'volume_name': 'volume-84b96c18-611b-442b-ac29-0decddb02bbc', 'volume_size': 1, 'snapshot_id': '939e62a0-d38d-49eb-971b-3f10b6096271'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0e97c2-be10-42a7-9cd0-44103589a5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0e97c2-be10-42a7-9cd0-44103589a5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0173fa78-25a6-418c-b0f5-6a11ae65491c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Volume 84b96c18-611b-442b-ac29-0decddb02bbc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84b96c18-611b-442b-ac29-0decddb02bbc', 'volume_size': 1, 'snapshot_id': '939e62a0-d38d-49eb-971b-3f10b6096271'}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:01 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7" returned: 0 in 0.766s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.233s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "cinder-quobyte-939e62a0-d38d-49eb-971b-3f10b6096271-84b96c18-611b-442b-ac29-0decddb02bbc" by "_create_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d95522-eacd-43bc-b2f6-0be535e95ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c476d708-4fd0-499e-b090-8bb4382831c7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2bef48-64bb-4141-986d-9f3b1b5c2cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-939e62a0-d38d-49eb-971b-3f10b6096271-84b96c18-611b-442b-ac29-0decddb02bbc" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Creating volume 84b96c18-611b-442b-ac29-0decddb02bbc from snapshot 939e62a0-d38d-49eb-971b-3f10b6096271 {{(pid=86763) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "cinder-quobyte-84b96c18-611b-442b-ac29-0decddb02bbc" by "_copy_volume_from_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:01 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Volume volume-c476d708-4fd0-499e-b090-8bb4382831c7 (c476d708-4fd0-499e-b090-8bb4382831c7): created successfully
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2bef48-64bb-4141-986d-9f3b1b5c2cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (a79597a7-9782-4663-a05b-8443de6233f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f4cb493c-e2fd-4239-9195-f4078b8ae44f tempest-ProjectReaderTests-563782695 None] Created volume successfully.
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-84b96c18-611b-442b-ac29-0decddb02bbc" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] snapshot: 939e62a0-d38d-49eb-971b-3f10b6096271, volume: 84b96c18-611b-442b-ac29-0decddb02bbc,  {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[521b1a46-2169-412d-8570-10531599b0cd]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:01 devstack sudo[108482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271
Jul 03 13:16:01 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:01 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f8776ad1-1488-445c-b908-febfe5dcbaf3" returned: 0 in 0.732s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-f8776ad1-1488-445c-b908-febfe5dcbaf3" released by "delete_volume" :: held 1.764s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Created reservations ['f8af92ef-cdd6-46bf-9029-237d1c551fc4', 'd74d6adc-053b-4859-997d-769ad78e5996', 'bf25f983-df08-480d-9c10-a1745e8f54bf', '90074c3d-f193-47a8-86e9-7fef23a72835'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:02 devstack sudo[108485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:16:02 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:02 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271" returned: 0 in 0.951s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-595c1610-f9e5-4b14-8f9e-82d86133e24f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Creating direct copy from snapshot {{(pid=86763) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[447f8de1-ac33-4c91-92f5-092abe43ca4e]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:02 devstack sudo[108490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f
Jul 03 13:16:02 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:02 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.812s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:02 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:16:02 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Deleted volume successfully.
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-31842e51-3f71-490e-9b7f-44b0f5fbef9c tempest-ProjectMemberTests-144615743 None] Lock "cinder-f8776ad1-1488-445c-b908-febfe5dcbaf3-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (b50da3d8-70d7-4a2c-b037-a1cb40ba3a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f42830c-26e5-4dc5-9401-420ebf5a4172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f42830c-26e5-4dc5-9401-420ebf5a4172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691306487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60620c5-ec16-4526-a8c0-361822b4c878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:03Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a787ab9e-3c5d-477e-a3b3-0829a465563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a787ab9e-3c5d-477e-a3b3-0829a465563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35840701-4288-435b-91cd-841fbc9e7c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35840701-4288-435b-91cd-841fbc9e7c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60620c5-ec16-4526-a8c0-361822b4c878', 'volume_name': 'volume-d60620c5-ec16-4526-a8c0-361822b4c878', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d590da-7343-4e67-b697-3849b1a1b666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d590da-7343-4e67-b697-3849b1a1b666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59eb2d3b-d530-4cc3-aeb6-102dc909ba0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:03 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Volume d60620c5-ec16-4526-a8c0-361822b4c878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60620c5-ec16-4526-a8c0-361822b4c878', 'volume_size': 1}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:03 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f" returned: 0 in 0.843s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG cinder.utils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Path /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc not found in is_blk_device check {{(pid=86763) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Jul 03 13:16:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:03 devstack sudo[108496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc
Jul 03 13:16:03 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:16:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:05 devstack sudo[108542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:16:05 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:06 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 1.712s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:06 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:16:08 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc" returned: 0 in 5.049s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:08 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7775e22d-a385-45e9-8d5b-ed6c5b8aca81]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:08 devstack sudo[108554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f
Jul 03 13:16:08 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:09 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f" returned: 0 in 0.995s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:09 devstack cinder-volume[86763]: DEBUG cinder.image.image_utils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Image conversion details: src /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc {{(pid=86763) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Jul 03 13:16:09 devstack cinder-volume[86763]: INFO cinder.image.image_utils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Converted 1024.00 MB image at 202.79 MB/s
Jul 03 13:16:09 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc is being set with open permissions: ugo+rw
Jul 03 13:16:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:09 devstack sudo[108559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc
Jul 03 13:16:09 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:10 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc" returned: 0 in 0.715s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-84b96c18-611b-442b-ac29-0decddb02bbc" released by "_copy_volume_from_snapshot" :: held 8.648s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-939e62a0-d38d-49eb-971b-3f10b6096271-84b96c18-611b-442b-ac29-0decddb02bbc" released by "_create_volume_from_snapshot" :: held 8.695s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.732s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.804s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] Creating offline snapshot 177978a0-c2e6-420f-b068-33f7045f7920 of volume c476d708-4fd0-499e-b090-8bb4382831c7 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0173fa78-25a6-418c-b0f5-6a11ae65491c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b96c18-611b-442b-ac29-0decddb02bbc', 'volume_size': 1, 'snapshot_id': '939e62a0-d38d-49eb-971b-3f10b6096271'}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f1e79d-2082-4bab-a557-a78848404518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4fc778-13ce-4fbb-bce6-3b1aa6f285b8]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:10 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Volume volume-84b96c18-611b-442b-ac29-0decddb02bbc (84b96c18-611b-442b-ac29-0decddb02bbc): created successfully
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f1e79d-2082-4bab-a557-a78848404518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:10 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Flow 'volume_create_manager' (989d9a22-57bb-4cf6-ab75-0de2b16edbf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:10 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e3531187-34c2-45e8-8eb5-fb4d96ab99cd tempest-SnapshotDependencyTests-1806513305 None] Created volume successfully.
Jul 03 13:16:10 devstack sudo[108562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7
Jul 03 13:16:10 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "cinder-939e62a0-d38d-49eb-971b-3f10b6096271-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-939e62a0-d38d-49eb-971b-3f10b6096271-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "cinder-quobyte-595c1610-f9e5-4b14-8f9e-82d86133e24f" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-595c1610-f9e5-4b14-8f9e-82d86133e24f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "cinder-quobyte-939e62a0-d38d-49eb-971b-3f10b6096271" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-939e62a0-d38d-49eb-971b-3f10b6096271" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Deleting offline snapshot 939e62a0-d38d-49eb-971b-3f10b6096271 of volume 595c1610-f9e5-4b14-8f9e-82d86133e24f {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] snapshot_file for this snap is: volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc16a3f-1a10-49fd-afe7-39ce7677cd04]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:11 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7" returned: 0 in 0.817s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:11 devstack sudo[108569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920 1G
Jul 03 13:16:11 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:11 devstack sudo[108568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271
Jul 03 13:16:11 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:12 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271" returned: 0 in 0.813s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-595c1610-f9e5-4b14-8f9e-82d86133e24f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:16:12 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920 1G" returned: 0 in 0.818s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c476d708-4fd0-499e-b090-8bb4382831c7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[90469796-9153-4b50-9390-9cc096b037ac]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:12 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c476d708-4fd0-499e-b090-8bb4382831c7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920
Jul 03 13:16:12 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:12 devstack sudo[108579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f
Jul 03 13:16:12 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:12 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c476d708-4fd0-499e-b090-8bb4382831c7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920" returned: 0 in 0.756s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:12 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920 is being set with open permissions: ugo+rw
Jul 03 13:16:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:12 devstack sudo[108588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920
Jul 03 13:16:12 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:12 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f" returned: 0 in 0.782s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:12 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271
Jul 03 13:16:12 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:13 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920" returned: 0 in 0.782s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:13 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:13 devstack sudo[108596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.info
Jul 03 13:16:13 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271" returned: 0 in 0.800s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:13 devstack sudo[108598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271
Jul 03 13:16:13 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:14 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f.939e62a0-d38d-49eb-971b-3f10b6096271" returned: 0 in 0.696s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:14 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.info" returned: 0 in 0.734s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:14 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.info is being set with open permissions: ugo+rw
Jul 03 13:16:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:14 devstack sudo[108602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.info
Jul 03 13:16:14 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-939e62a0-d38d-49eb-971b-3f10b6096271" released by "_delete_snapshot" :: held 3.223s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-595c1610-f9e5-4b14-8f9e-82d86133e24f" released by "delete_snapshot" :: held 3.252s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:14 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Created reservations ['175f4c56-5ccb-4eb9-be7b-c5a6a9b9c41e', '1390b1f6-9141-425b-8c64-669fe7f2de71', 'c2237ac2-0595-4078-932e-245317179efd', 'd09a0954-2bb8-4765-93e4-38908beb270a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:14 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Delete snapshot completed successfully.
Jul 03 13:16:14 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8581710a-8823-4a32-b57c-da862eb27091 tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-939e62a0-d38d-49eb-971b-3f10b6096271-delete_snapshot" released by "delete_snapshot" :: held 3.415s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:14 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.info" returned: 0 in 0.646s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.637s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.847s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691306487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60620c5-ec16-4526-a8c0-361822b4c878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:03Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Creating volume d60620c5-ec16-4526-a8c0-361822b4c878 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:16:15 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:15 devstack sudo[108605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878 1073741824
Jul 03 13:16:15 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9ba2882f-f91c-4e94-8705-742c8bdbc3c7 tempest-ProjectReaderTests-563782695 None] Create snapshot completed successfully
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-177978a0-c2e6-420f-b068-33f7045f7920-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Lock "cinder-177978a0-c2e6-420f-b068-33f7045f7920-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-c476d708-4fd0-499e-b090-8bb4382831c7" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-c476d708-4fd0-499e-b090-8bb4382831c7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-177978a0-c2e6-420f-b068-33f7045f7920" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-177978a0-c2e6-420f-b068-33f7045f7920" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Deleting offline snapshot 177978a0-c2e6-420f-b068-33f7045f7920 of volume c476d708-4fd0-499e-b090-8bb4382831c7 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] snapshot_file for this snap is: volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a041c98-ee64-4803-beb1-5898f52f79c6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "cinder-595c1610-f9e5-4b14-8f9e-82d86133e24f-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-595c1610-f9e5-4b14-8f9e-82d86133e24f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "cinder-quobyte-595c1610-f9e5-4b14-8f9e-82d86133e24f" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-595c1610-f9e5-4b14-8f9e-82d86133e24f" acquired by "delete_volume" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:15 devstack sudo[108607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920
Jul 03 13:16:15 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b662a4ad-0a86-48e4-aad5-7b7d5f35d08f]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:15 devstack sudo[108609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f
Jul 03 13:16:15 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:16 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878 1073741824" returned: 0 in 1.012s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:16 devstack sudo[108615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878
Jul 03 13:16:16 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:16 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920" returned: 0 in 0.900s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c476d708-4fd0-499e-b090-8bb4382831c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ba4f41-68db-433f-b4cb-256e58b8bc20]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:16 devstack sudo[108619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7
Jul 03 13:16:16 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:16 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f" returned: 0 in 1.025s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:16 devstack sudo[108625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f
Jul 03 13:16:16 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:16 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878" returned: 0 in 0.723s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59eb2d3b-d530-4cc3-aeb6-102dc909ba0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60620c5-ec16-4526-a8c0-361822b4c878', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb51ec9-4467-4823-9199-42022e9e173e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:16 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Volume volume-d60620c5-ec16-4526-a8c0-361822b4c878 (d60620c5-ec16-4526-a8c0-361822b4c878): created successfully
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb51ec9-4467-4823-9199-42022e9e173e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:16 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (b50da3d8-70d7-4a2c-b037-a1cb40ba3a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:16 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1d670113-15a5-407b-b48e-21cd099981d8 tempest-ProjectMemberTests-144615743 None] Created volume successfully.
Jul 03 13:16:17 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7" returned: 0 in 0.871s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:17 devstack sudo[108631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920
Jul 03 13:16:17 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] Creating offline snapshot 901092af-6c48-4b74-aea3-c93990744c18 of volume d60620c5-ec16-4526-a8c0-361822b4c878 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8140720e-55a0-494f-8aae-ff8818a476ba]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:17 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-595c1610-f9e5-4b14-8f9e-82d86133e24f" returned: 0 in 0.937s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:17 devstack sudo[108634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878
Jul 03 13:16:17 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-595c1610-f9e5-4b14-8f9e-82d86133e24f" released by "delete_volume" :: held 2.036s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Created reservations ['2bd10ff9-5fcb-4221-99df-756aa338881b', '3777bbbd-d60e-49be-a650-96d7c2a6f54c', '554e8545-0e48-42bd-8fb4-f97362da353e', '5f115e55-9e6e-46e9-84b1-42314e3c7c9b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:17 devstack sudo[108636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:16:17 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:18 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920" returned: 0 in 0.928s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:18 devstack sudo[108642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920
Jul 03 13:16:18 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:18 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878" returned: 0 in 0.884s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:18 devstack sudo[108647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18 1G
Jul 03 13:16:18 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:18 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.706s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:16:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Deleted volume successfully.
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-9e74b043-a3b0-4552-83e7-d2399501ec27 tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-595c1610-f9e5-4b14-8f9e-82d86133e24f-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "cinder-84b96c18-611b-442b-ac29-0decddb02bbc-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-84b96c18-611b-442b-ac29-0decddb02bbc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:18 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7.177978a0-c2e6-420f-b068-33f7045f7920" returned: 0 in 0.751s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "cinder-quobyte-84b96c18-611b-442b-ac29-0decddb02bbc" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-177978a0-c2e6-420f-b068-33f7045f7920" released by "_delete_snapshot" :: held 3.582s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-c476d708-4fd0-499e-b090-8bb4382831c7" released by "delete_snapshot" :: held 3.611s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-84b96c18-611b-442b-ac29-0decddb02bbc" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced63dc9-a8de-4f43-a9e3-83d41aa0ac36]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Created reservations ['e7d67405-9371-404b-8281-607557ce71d4', '95a5892d-c641-4daf-95a5-febe15d55321', '032ef482-83ef-46ec-9947-11f6a86ebec1', 'bf012a97-25f2-4105-9f55-b3d9d35ba057'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:19 devstack sudo[108653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc
Jul 03 13:16:19 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Delete snapshot completed successfully.
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bf4e0804-5cb2-477c-ac1b-2c0a2504d8d8 tempest-ProjectReaderTests-563782695 None] Lock "cinder-177978a0-c2e6-420f-b068-33f7045f7920-delete_snapshot" released by "delete_snapshot" :: held 3.842s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:19 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18 1G" returned: 0 in 0.972s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d60620c5-ec16-4526-a8c0-361822b4c878 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:19 devstack sudo[108655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d60620c5-ec16-4526-a8c0-361822b4c878 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18
Jul 03 13:16:19 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-c476d708-4fd0-499e-b090-8bb4382831c7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Lock "cinder-c476d708-4fd0-499e-b090-8bb4382831c7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-c476d708-4fd0-499e-b090-8bb4382831c7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-c476d708-4fd0-499e-b090-8bb4382831c7" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadb3141-0093-4ad8-94ab-a6b1afd23fcb]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:19 devstack sudo[108660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7
Jul 03 13:16:19 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:19 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc" returned: 0 in 0.939s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:19 devstack sudo[108665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc
Jul 03 13:16:19 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:20 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d60620c5-ec16-4526-a8c0-361822b4c878 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18" returned: 0 in 0.782s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:20 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18 is being set with open permissions: ugo+rw
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:20 devstack sudo[108670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18
Jul 03 13:16:20 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:20 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7" returned: 0 in 0.910s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:20 devstack sudo[108677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7
Jul 03 13:16:20 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:20 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18" returned: 0 in 0.700s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:20 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-84b96c18-611b-442b-ac29-0decddb02bbc" returned: 0 in 0.875s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-quobyte-84b96c18-611b-442b-ac29-0decddb02bbc" released by "delete_volume" :: held 1.875s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:20 devstack sudo[108679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.info
Jul 03 13:16:20 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Created reservations ['c2f128e1-6b74-4c9e-adb8-f3c0841bcca7', 'af1c75df-36f8-4c51-9642-1f7fc5fad86c', '61ad1c70-e09e-4830-bf4e-17016662fcc9', '58a1cd53-2a1d-482b-b3a9-e0fb2c8db3cf'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:21 devstack sudo[108682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:16:21 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:21 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.info" returned: 0 in 0.726s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:21 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.info is being set with open permissions: ugo+rw
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:21 devstack sudo[108686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.info
Jul 03 13:16:21 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:21 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c476d708-4fd0-499e-b090-8bb4382831c7" returned: 0 in 0.951s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-c476d708-4fd0-499e-b090-8bb4382831c7" released by "delete_volume" :: held 1.960s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Created reservations ['3e4744fc-b7d2-4458-aa00-1115b1a2fec9', '0dd218b5-dcf9-4748-900e-149f54def7e3', 'cea33f94-4faf-4b88-90b7-186577c53956', '03c345a7-ad4c-48c6-99bc-5bea698b6e89'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:21 devstack sudo[108689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:16:21 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:21 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.918s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:16:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Deleted volume successfully.
Jul 03 13:16:21 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e6d093eb-301a-4e47-a2d8-c918387ad6dc tempest-SnapshotDependencyTests-1806513305 None] Lock "cinder-84b96c18-611b-442b-ac29-0decddb02bbc-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:22 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.info" returned: 0 in 0.943s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.143s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8e62daa2-4087-4d17-a57e-70190f2ddd5f tempest-ProjectMemberTests-144615743 None] Create snapshot completed successfully
Jul 03 13:16:22 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.862s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:22 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:16:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Deleted volume successfully.
Jul 03 13:16:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-7861fe23-5351-46b8-a7da-a46fc46cc412 tempest-ProjectReaderTests-563782695 None] Lock "cinder-c476d708-4fd0-499e-b090-8bb4382831c7-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (cad656dc-91f9-4a85-92d2-c3b5cf254076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15610125-67de-4f63-8068-bbf6d03cf7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15610125-67de-4f63-8068-bbf6d03cf7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639545121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b6ecf4-f677-4021-95c0-eb24c7d4994f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:24Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1c07ea-59f7-40d7-b15f-bc4a4c5eac67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1c07ea-59f7-40d7-b15f-bc4a4c5eac67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68990636-0ee2-4ab1-90e2-5bb13fc39048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68990636-0ee2-4ab1-90e2-5bb13fc39048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b6ecf4-f677-4021-95c0-eb24c7d4994f', 'volume_name': 'volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adb05de-8b87-4491-9bb2-69801597d4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adb05de-8b87-4491-9bb2-69801597d4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4b16a7-21bc-4fce-af7a-83e61e5a23ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:23 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Volume 30b6ecf4-f677-4021-95c0-eb24c7d4994f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f', 'volume_size': 1}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639545121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b6ecf4-f677-4021-95c0-eb24c7d4994f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:24Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Creating volume 30b6ecf4-f677-4021-95c0-eb24c7d4994f {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:16:23 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-901092af-6c48-4b74-aea3-c93990744c18-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:23 devstack sudo[108694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f 1073741824
Jul 03 13:16:23 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Lock "cinder-901092af-6c48-4b74-aea3-c93990744c18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-d60620c5-ec16-4526-a8c0-361822b4c878" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-d60620c5-ec16-4526-a8c0-361822b4c878" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-901092af-6c48-4b74-aea3-c93990744c18" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-901092af-6c48-4b74-aea3-c93990744c18" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Deleting offline snapshot 901092af-6c48-4b74-aea3-c93990744c18 of volume d60620c5-ec16-4526-a8c0-361822b4c878 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] snapshot_file for this snap is: volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b3f187-63c6-4cf2-9d47-bb81a9a54017]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:23 devstack sudo[108696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18
Jul 03 13:16:23 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:24 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18" returned: 0 in 0.961s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:24 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d60620c5-ec16-4526-a8c0-361822b4c878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:16:24 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[244fb6ac-79e0-4da3-9fb7-5c048210c17a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:24 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f 1073741824" returned: 0 in 1.266s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:25 devstack sudo[108705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878
Jul 03 13:16:25 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:25 devstack sudo[108706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f
Jul 03 13:16:25 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:25 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f" returned: 0 in 0.820s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:16:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4b16a7-21bc-4fce-af7a-83e61e5a23ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511ae21e-c70a-4329-972e-60a416039a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:25 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878" returned: 0 in 1.006s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:25 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Volume volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f (30b6ecf4-f677-4021-95c0-eb24c7d4994f): created successfully
Jul 03 13:16:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511ae21e-c70a-4329-972e-60a416039a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:25 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (cad656dc-91f9-4a85-92d2-c3b5cf254076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:25 devstack sudo[108714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18
Jul 03 13:16:25 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-7943fae7-a75d-456e-b63d-7dcc5d2b72f9 tempest-ProjectReaderTests-563782695 None] Created volume successfully.
Jul 03 13:16:26 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18" returned: 0 in 0.976s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:26 devstack sudo[108720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18
Jul 03 13:16:26 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] Creating offline snapshot cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a of volume 30b6ecf4-f677-4021-95c0-eb24c7d4994f {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:16:27 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8c2e39-a6eb-4132-b3ea-5659ddf31de2]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:27 devstack sudo[108722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f
Jul 03 13:16:27 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:27 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878.901092af-6c48-4b74-aea3-c93990744c18" returned: 0 in 0.870s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-901092af-6c48-4b74-aea3-c93990744c18" released by "_delete_snapshot" :: held 4.010s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-d60620c5-ec16-4526-a8c0-361822b4c878" released by "delete_snapshot" :: held 4.046s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:27 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Created reservations ['18ff8608-ee7b-4dd0-92c1-7cbfaebf8a50', '2a30afdc-0203-47aa-aeee-0e9df654091d', '1701ed43-8c33-49d5-8423-d57c3bdadc13', 'e5d67c86-d194-4e59-a72b-3f09b985435c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Delete snapshot completed successfully.
Jul 03 13:16:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e97c2742-e1b0-4263-8185-3f9520fc5800 tempest-ProjectMemberTests-144615743 None] Lock "cinder-901092af-6c48-4b74-aea3-c93990744c18-delete_snapshot" released by "delete_snapshot" :: held 4.240s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-d60620c5-ec16-4526-a8c0-361822b4c878-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Lock "cinder-d60620c5-ec16-4526-a8c0-361822b4c878-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-d60620c5-ec16-4526-a8c0-361822b4c878" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-d60620c5-ec16-4526-a8c0-361822b4c878" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb307e-08a1-4dc4-ae43-6306f7208809]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:28 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f" returned: 0 in 1.083s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:28 devstack sudo[108730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a 1G
Jul 03 13:16:28 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:28 devstack sudo[108729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878
Jul 03 13:16:28 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:29 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878" returned: 0 in 0.889s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:29 devstack sudo[108740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878
Jul 03 13:16:29 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:29 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a 1G" returned: 0 in 1.051s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:29 devstack sudo[108742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a
Jul 03 13:16:29 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:29 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d60620c5-ec16-4526-a8c0-361822b4c878" returned: 0 in 0.815s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-d60620c5-ec16-4526-a8c0-361822b4c878" released by "delete_volume" :: held 1.783s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:29 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Created reservations ['0c35c22f-0d67-4026-8685-c5ce92d9b561', 'a4d19087-3256-4a3d-988b-18ae347fce4f', '602f1a09-9ec1-4bd8-9c67-c390a0008c55', 'a74159d0-9354-403d-b045-f8ad398144bd'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:29 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a" returned: 0 in 0.733s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:30 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a is being set with open permissions: ugo+rw
Jul 03 13:16:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:30 devstack sudo[108748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a
Jul 03 13:16:30 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:30 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:30 devstack sudo[108750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:16:30 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:31 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.945s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:16:31 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Deleted volume successfully.
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (28ac2793-6aa5-4e3c-83ec-203baf8841b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b65c4d-640e-4c05-aae6-54520049ef7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b65c4d-640e-4c05-aae6-54520049ef7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640780276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab24f4d-420e-4829-aac2-6a54b9e1a3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:31Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:31 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45514c7-b764-4981-a8fc-7fa68938bb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45514c7-b764-4981-a8fc-7fa68938bb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d39465-cfa7-45ca-b799-3a2a54838c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d39465-cfa7-45ca-b799-3a2a54838c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ab24f4d-420e-4829-aac2-6a54b9e1a3f7', 'volume_name': 'volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89067ab0-971e-4e35-a8a6-78ad6c86c602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89067ab0-971e-4e35-a8a6-78ad6c86c602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a04622c-dbaa-4d65-95d1-9f02ffc2a430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:31 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Volume 8ab24f4d-420e-4829-aac2-6a54b9e1a3f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7', 'volume_size': 1}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-bef63322-991c-4135-99cb-82131eef63f7 tempest-ProjectMemberTests-144615743 None] Lock "cinder-d60620c5-ec16-4526-a8c0-361822b4c878-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a" returned: 0 in 1.176s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:31 devstack sudo[108756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.info
Jul 03 13:16:31 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:32 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.info" returned: 0 in 0.818s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:32 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.info is being set with open permissions: ugo+rw
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:32 devstack sudo[108761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.info
Jul 03 13:16:32 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:32 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-30b6ecf4-f677-4021-95c0-eb24c7d4994f.info" returned: 0 in 0.686s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.670s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640780276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab24f4d-420e-4829-aac2-6a54b9e1a3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:31Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Creating volume 8ab24f4d-420e-4829-aac2-6a54b9e1a3f7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:16:32 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:16:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:32 devstack sudo[108764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7 1073741824
Jul 03 13:16:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ba2ab06f-6ce4-4b83-a666-4afeb95767ea tempest-ProjectReaderTests-563782695 None] Create snapshot completed successfully
Jul 03 13:16:32 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d5d9521-8ed8-475d-a47b-4e4c9b87b815 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d5d9521-8ed8-475d-a47b-4e4c9b87b815 tempest-ProjectReaderTests-563782695 None] Lock "cinder-cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:33 devstack cinder-volume[86763]: INFO cinder.message.api [None req-2d5d9521-8ed8-475d-a47b-4e4c9b87b815 tempest-ProjectReaderTests-563782695 None] Creating message record for request_id = req-2d5d9521-8ed8-475d-a47b-4e4c9b87b815
Jul 03 13:16:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-2d5d9521-8ed8-475d-a47b-4e4c9b87b815 tempest-ProjectReaderTests-563782695 None] Lock "cinder-cbdf5d4e-f091-4d8a-bfae-c106ea0a1a7a-delete_snapshot" released by "delete_snapshot" :: held 0.056s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server [None req-2d5d9521-8ed8-475d-a47b-4e4c9b87b815 tempest-ProjectReaderTests-563782695 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 219, in wrapper
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, snapshot, *args, **kwargs)
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     self.driver.unmanage_snapshot(snapshot)
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 13:16:33 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server 
Jul 03 13:16:33 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7 1073741824" returned: 0 in 1.070s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:33 devstack sudo[108770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7
Jul 03 13:16:33 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:34 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7" returned: 0 in 0.777s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:16:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a04622c-dbaa-4d65-95d1-9f02ffc2a430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178fc23a-2520-480c-ac6d-4ee5e4381c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Volume volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7 (8ab24f4d-420e-4829-aac2-6a54b9e1a3f7): created successfully
Jul 03 13:16:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178fc23a-2520-480c-ac6d-4ee5e4381c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (28ac2793-6aa5-4e3c-83ec-203baf8841b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:34 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d1d3cc2c-efc0-4f58-b6c2-4ed78cbbdfe9 tempest-ProjectMemberTests-144615743 None] Created volume successfully.
Jul 03 13:16:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] Creating offline snapshot 3613ff29-d1ba-4ae2-a04b-9d4688fb4b97 of volume 8ab24f4d-420e-4829-aac2-6a54b9e1a3f7 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:16:35 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8618e03-8a46-4bd4-aa99-04d6d0caa734]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:35 devstack sudo[108773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7
Jul 03 13:16:35 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:36 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7" returned: 0 in 0.876s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.3613ff29-d1ba-4ae2-a04b-9d4688fb4b97 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:36 devstack sudo[108778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.3613ff29-d1ba-4ae2-a04b-9d4688fb4b97 1G
Jul 03 13:16:36 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:37 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.3613ff29-d1ba-4ae2-a04b-9d4688fb4b97 1G" returned: 0 in 0.906s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.3613ff29-d1ba-4ae2-a04b-9d4688fb4b97 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:37 devstack sudo[108784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.3613ff29-d1ba-4ae2-a04b-9d4688fb4b97
Jul 03 13:16:37 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:38 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.3613ff29-d1ba-4ae2-a04b-9d4688fb4b97" returned: 0 in 0.738s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:38 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.3613ff29-d1ba-4ae2-a04b-9d4688fb4b97 is being set with open permissions: ugo+rw
Jul 03 13:16:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.3613ff29-d1ba-4ae2-a04b-9d4688fb4b97 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:38 devstack sudo[108789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.3613ff29-d1ba-4ae2-a04b-9d4688fb4b97
Jul 03 13:16:38 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:38 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.3613ff29-d1ba-4ae2-a04b-9d4688fb4b97" returned: 0 in 0.690s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:38 devstack sudo[108792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.info
Jul 03 13:16:38 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:39 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.info" returned: 0 in 0.709s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:39 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.info is being set with open permissions: ugo+rw
Jul 03 13:16:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:39 devstack sudo[108795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.info
Jul 03 13:16:39 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:40 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-8ab24f4d-420e-4829-aac2-6a54b9e1a3f7.info" returned: 0 in 0.688s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.705s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6a7f9103-d15e-4374-a7e3-bcde3ab56d96 tempest-ProjectMemberTests-144615743 None] Create snapshot completed successfully
Jul 03 13:16:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5ce87c1c-ea88-483b-b120-47a04acc79c4 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-3613ff29-d1ba-4ae2-a04b-9d4688fb4b97-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5ce87c1c-ea88-483b-b120-47a04acc79c4 tempest-ProjectMemberTests-144615743 None] Lock "cinder-3613ff29-d1ba-4ae2-a04b-9d4688fb4b97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:40 devstack cinder-volume[86763]: INFO cinder.message.api [None req-5ce87c1c-ea88-483b-b120-47a04acc79c4 tempest-ProjectMemberTests-144615743 None] Creating message record for request_id = req-5ce87c1c-ea88-483b-b120-47a04acc79c4
Jul 03 13:16:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-5ce87c1c-ea88-483b-b120-47a04acc79c4 tempest-ProjectMemberTests-144615743 None] Lock "cinder-3613ff29-d1ba-4ae2-a04b-9d4688fb4b97-delete_snapshot" released by "delete_snapshot" :: held 0.042s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server [None req-5ce87c1c-ea88-483b-b120-47a04acc79c4 tempest-ProjectMemberTests-144615743 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 219, in wrapper
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, snapshot, *args, **kwargs)
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     self.driver.unmanage_snapshot(snapshot)
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 13:16:40 devstack cinder-volume[86763]: ERROR oslo_messaging.rpc.server 
Jul 03 13:16:50 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=84,cinder:UPDATE=112,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:16:50 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=92,cinder:SELECT=79,cinder:DELETE=10,cinder:INSERT=31 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:17:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:17:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:05 devstack sudo[108808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:17:05 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:05 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.687s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:18:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:18:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:18:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:18:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:18:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:18:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:18:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:18:05 devstack sudo[108863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:18:05 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:18:05 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root
Jul 03 13:18:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.676s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:18:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:18:45 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:18:45 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=1 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:19:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:19:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:19:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:19:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:05 devstack sudo[108920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:19:05 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:05 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.660s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (4a03345c-6ad0-4997-b3a3-086f0338e7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491d29df-2b52-4d7c-858c-eddf6b2c0fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491d29df-2b52-4d7c-858c-eddf6b2c0fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1101596060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae260aab-db09-4413-bdcd-c9c37d51f2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:19:50Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b591f42-74c8-404a-b4d2-0697ba8768c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b591f42-74c8-404a-b4d2-0697ba8768c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4181d113-24f8-40c4-b673-8eaa80135bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4181d113-24f8-40c4-b673-8eaa80135bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae260aab-db09-4413-bdcd-c9c37d51f2d2', 'volume_name': 'volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff99a17-e27b-4643-92e8-61a4043d6714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff99a17-e27b-4643-92e8-61a4043d6714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd2ea7a-6b18-4422-a578-417c5e37bb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:50 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Volume ae260aab-db09-4413-bdcd-c9c37d51f2d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2', 'volume_size': 1}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1101596060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae260aab-db09-4413-bdcd-c9c37d51f2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:19:50Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Creating volume ae260aab-db09-4413-bdcd-c9c37d51f2d2 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:19:50 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:19:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:50 devstack sudo[108969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 1073741824
Jul 03 13:19:50 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:51 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 1073741824" returned: 0 in 0.790s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:51 devstack sudo[108975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2
Jul 03 13:19:51 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:51 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2" returned: 0 in 0.652s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:51 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:19:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd2ea7a-6b18-4422-a578-417c5e37bb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee512379-6c1e-4158-90dc-4f5a86ca0af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:52 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Volume volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 (ae260aab-db09-4413-bdcd-c9c37d51f2d2): created successfully
Jul 03 13:19:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee512379-6c1e-4158-90dc-4f5a86ca0af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:52 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (4a03345c-6ad0-4997-b3a3-086f0338e7dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:19:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b13b062e-7141-464b-a42a-c00ed8e4593b tempest-ProjectReaderTests-563782695 None] Created volume successfully.
Jul 03 13:19:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] Creating offline snapshot a7b46648-c33a-4777-97a6-2b5093721419 of volume ae260aab-db09-4413-bdcd-c9c37d51f2d2 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:19:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9c320b-25ff-42fa-a286-26a6a55ec558]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:19:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:52 devstack sudo[108978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2
Jul 03 13:19:52 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:53 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2" returned: 0 in 0.793s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:53 devstack sudo[108983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419 1G
Jul 03 13:19:53 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:54 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419 1G" returned: 0 in 0.852s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:54 devstack sudo[108989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419
Jul 03 13:19:54 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:55 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419" returned: 0 in 0.820s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:55 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419 is being set with open permissions: ugo+rw
Jul 03 13:19:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:55 devstack sudo[108994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419
Jul 03 13:19:55 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:55 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419" returned: 0 in 0.688s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:55 devstack sudo[108997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.info
Jul 03 13:19:55 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:56 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.info" returned: 0 in 0.690s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:56 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.info is being set with open permissions: ugo+rw
Jul 03 13:19:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:56 devstack sudo[109000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.info
Jul 03 13:19:56 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (1038f2a0-5c2a-4b3e-b40a-d7abb31dbbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7182d7cc-4786-41ec-90f8-a27bbe549c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7182d7cc-4786-41ec-90f8-a27bbe549c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100747333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81893277-32cb-494b-85e6-d5a2b65d021a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:19:57Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd6b18c-ece4-4e2f-ab69-f878fd7e1c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd6b18c-ece4-4e2f-ab69-f878fd7e1c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad2c5ce-b5ba-41c6-bf8c-11c363b073ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad2c5ce-b5ba-41c6-bf8c-11c363b073ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81893277-32cb-494b-85e6-d5a2b65d021a', 'volume_name': 'volume-81893277-32cb-494b-85e6-d5a2b65d021a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea80a7f-5bbd-4c86-af75-9a0aa6e47f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea80a7f-5bbd-4c86-af75-9a0aa6e47f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:57 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7449353-00f3-4ab9-865a-412f4c6d508f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:57 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Volume 81893277-32cb-494b-85e6-d5a2b65d021a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81893277-32cb-494b-85e6-d5a2b65d021a', 'volume_size': 1}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.info" returned: 0 in 0.707s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.633s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1100747333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81893277-32cb-494b-85e6-d5a2b65d021a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:19:57Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Creating volume 81893277-32cb-494b-85e6-d5a2b65d021a {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:19:57 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:57 devstack sudo[109003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a 1073741824
Jul 03 13:19:57 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:57 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-d0379180-5794-4378-a146-a22ad3c106d2 tempest-ProjectReaderTests-563782695 None] Create snapshot completed successfully
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-a7b46648-c33a-4777-97a6-2b5093721419-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Lock "cinder-a7b46648-c33a-4777-97a6-2b5093721419-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-ae260aab-db09-4413-bdcd-c9c37d51f2d2" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-ae260aab-db09-4413-bdcd-c9c37d51f2d2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-a7b46648-c33a-4777-97a6-2b5093721419" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-a7b46648-c33a-4777-97a6-2b5093721419" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:19:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Deleting offline snapshot a7b46648-c33a-4777-97a6-2b5093721419 of volume ae260aab-db09-4413-bdcd-c9c37d51f2d2 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] snapshot_file for this snap is: volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[964945a3-ad1c-46bd-ade6-b28993d7264b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:58 devstack sudo[109009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419
Jul 03 13:19:58 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:58 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a 1073741824" returned: 0 in 0.946s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:58 devstack sudo[109011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a
Jul 03 13:19:58 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:58 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a" returned: 0 in 0.648s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:58 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7449353-00f3-4ab9-865a-412f4c6d508f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81893277-32cb-494b-85e6-d5a2b65d021a', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ee3ab6-8787-4fb7-9af9-84d622a8a747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419" returned: 0 in 0.940s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:19:58 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Volume volume-81893277-32cb-494b-85e6-d5a2b65d021a (81893277-32cb-494b-85e6-d5a2b65d021a): created successfully
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ee3ab6-8787-4fb7-9af9-84d622a8a747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:58 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (1038f2a0-5c2a-4b3e-b40a-d7abb31dbbea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:19:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f637854b-8aa4-4fda-a95f-d39dcb00d874]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:19:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:59 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1facdcd3-75ac-4c8c-8bd7-b6bb5a3c1a47 tempest-ProjectMemberTests-144615743 None] Created volume successfully.
Jul 03 13:19:59 devstack sudo[109018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2
Jul 03 13:19:59 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:59 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] Creating offline snapshot df816930-4b76-49e8-a6a2-57592a835dcd of volume 81893277-32cb-494b-85e6-d5a2b65d021a {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:19:59 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89437f9-3088-4486-a11a-229dfa216c82]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:19:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:59 devstack sudo[109020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a
Jul 03 13:19:59 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:59 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2" returned: 0 in 0.801s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:59 devstack sudo[109025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419
Jul 03 13:19:59 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:00 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a" returned: 0 in 0.766s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:00 devstack sudo[109030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd 1G
Jul 03 13:20:00 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:00 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419" returned: 0 in 0.826s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:00 devstack sudo[109035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419
Jul 03 13:20:00 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:01 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd 1G" returned: 0 in 0.824s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81893277-32cb-494b-85e6-d5a2b65d021a -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:01 devstack sudo[109040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81893277-32cb-494b-85e6-d5a2b65d021a -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd
Jul 03 13:20:01 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:01 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2.a7b46648-c33a-4777-97a6-2b5093721419" returned: 0 in 0.697s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-a7b46648-c33a-4777-97a6-2b5093721419" released by "_delete_snapshot" :: held 3.379s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-ae260aab-db09-4413-bdcd-c9c37d51f2d2" released by "delete_snapshot" :: held 3.403s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:01 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Created reservations ['1609a8f0-ce89-45c4-91d9-7496b0a7bb5a', '57fc5d93-c8a7-4aca-aa7c-5d4160e32c13', '7f55255a-be9f-4a80-8a3e-264b3be6d7d9', '4b300c7b-f45a-4323-a75c-8eeed28ef11b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Delete snapshot completed successfully.
Jul 03 13:20:01 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-13cdc04d-b0eb-4a5b-b703-c34ce745d5e4 tempest-ProjectReaderTests-563782695 None] Lock "cinder-a7b46648-c33a-4777-97a6-2b5093721419-delete_snapshot" released by "delete_snapshot" :: held 3.578s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:01 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81893277-32cb-494b-85e6-d5a2b65d021a -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd" returned: 0 in 0.728s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:01 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd is being set with open permissions: ugo+rw
Jul 03 13:20:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:01 devstack sudo[109049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd
Jul 03 13:20:01 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-ae260aab-db09-4413-bdcd-c9c37d51f2d2-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Lock "cinder-ae260aab-db09-4413-bdcd-c9c37d51f2d2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-ae260aab-db09-4413-bdcd-c9c37d51f2d2" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-ae260aab-db09-4413-bdcd-c9c37d51f2d2" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a363dc-3b15-4596-bb4f-e63e9bcf1d28]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:02 devstack sudo[109051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2
Jul 03 13:20:02 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:02 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd" returned: 0 in 0.714s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:02 devstack sudo[109054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.info
Jul 03 13:20:02 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:03 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2" returned: 0 in 0.898s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:03 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.info" returned: 0 in 0.719s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:03 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.info is being set with open permissions: ugo+rw
Jul 03 13:20:03 devstack sudo[109060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2
Jul 03 13:20:03 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:03 devstack sudo[109062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.info
Jul 03 13:20:03 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:03 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-ae260aab-db09-4413-bdcd-c9c37d51f2d2" returned: 0 in 0.677s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:03 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-ae260aab-db09-4413-bdcd-c9c37d51f2d2" released by "delete_volume" :: held 1.640s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:03 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Created reservations ['ee44b507-6487-4453-9870-8644515d8672', 'dff5ebea-7a70-4919-ad49-4a8125f6bf2f', '23607e40-c277-45d1-a8a0-565fc86ce5af', '644ffa9d-7c15-40d5-894d-f796364e00f6'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:04 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.info" returned: 0 in 0.796s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.658s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-08416ff0-3081-4720-ab79-4ab5012c277f tempest-ProjectMemberTests-144615743 None] Create snapshot completed successfully
Jul 03 13:20:04 devstack sudo[109066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:20:04 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-df816930-4b76-49e8-a6a2-57592a835dcd-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Lock "cinder-df816930-4b76-49e8-a6a2-57592a835dcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-81893277-32cb-494b-85e6-d5a2b65d021a" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-81893277-32cb-494b-85e6-d5a2b65d021a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-df816930-4b76-49e8-a6a2-57592a835dcd" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-df816930-4b76-49e8-a6a2-57592a835dcd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:04 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Deleting offline snapshot df816930-4b76-49e8-a6a2-57592a835dcd of volume 81893277-32cb-494b-85e6-d5a2b65d021a {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] snapshot_file for this snap is: volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.739s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:20:04 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Deleted volume successfully.
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b0a1c9-4113-43d6-8a5e-b6ced574ad39]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:04 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-07bdb40d-0869-450f-9482-e1f8e1281062 tempest-ProjectReaderTests-563782695 None] Lock "cinder-ae260aab-db09-4413-bdcd-c9c37d51f2d2-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:04 devstack sudo[109069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd
Jul 03 13:20:04 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (1f42603d-8d4d-4ab4-8f58-338602d3f055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15277181-5108-4c99-ae8f-d4b23d80798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15277181-5108-4c99-ae8f-d4b23d80798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346412069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9725b85-4c73-45a1-a967-c142e3184539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:05Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaf4da0-6893-461b-b55e-6c663eec97c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaf4da0-6893-461b-b55e-6c663eec97c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beec4209-fe09-4684-a46f-68e285e3d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beec4209-fe09-4684-a46f-68e285e3d072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9725b85-4c73-45a1-a967-c142e3184539', 'volume_name': 'volume-a9725b85-4c73-45a1-a967-c142e3184539', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f3d2f6-d7ed-4dc9-80a4-953c70fe97e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f3d2f6-d7ed-4dc9-80a4-953c70fe97e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe720d7-b3cd-4a05-80fc-ce07e875fefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:05 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Volume a9725b85-4c73-45a1-a967-c142e3184539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9725b85-4c73-45a1-a967-c142e3184539', 'volume_size': 1}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346412069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9725b85-4c73-45a1-a967-c142e3184539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:05Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Creating volume a9725b85-4c73-45a1-a967-c142e3184539 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:20:05 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:05 devstack sudo[109071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539 1073741824
Jul 03 13:20:05 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:05 devstack sudo[109072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:20:05 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:05 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd" returned: 0 in 0.834s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81893277-32cb-494b-85e6-d5a2b65d021a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3f3ae8-6e36-44ad-83e0-c9195207a93a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:05 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.687s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:20:05 devstack sudo[109081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a
Jul 03 13:20:05 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:06 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539 1073741824" returned: 0 in 0.941s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:06 devstack sudo[109091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539
Jul 03 13:20:06 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:06 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a" returned: 0 in 0.808s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:06 devstack sudo[109096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd
Jul 03 13:20:06 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:06 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539" returned: 0 in 0.730s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:06 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:20:06 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe720d7-b3cd-4a05-80fc-ce07e875fefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9725b85-4c73-45a1-a967-c142e3184539', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc46167d-9d50-4a8a-9613-112ae5640672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:06 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Volume volume-a9725b85-4c73-45a1-a967-c142e3184539 (a9725b85-4c73-45a1-a967-c142e3184539): created successfully
Jul 03 13:20:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc46167d-9d50-4a8a-9613-112ae5640672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:06 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (1f42603d-8d4d-4ab4-8f58-338602d3f055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6056cd16-286f-4599-81e4-9385612242f5 tempest-ProjectReaderTests-563782695 None] Created volume successfully.
Jul 03 13:20:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:07 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] Creating offline snapshot bfa22d63-19d6-4553-a44d-0eddf96bb87b of volume a9725b85-4c73-45a1-a967-c142e3184539 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:20:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e165c489-efd5-4b13-99bf-0b96ada09e96]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:07 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd" returned: 0 in 0.874s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:07 devstack sudo[109142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd
Jul 03 13:20:07 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:07 devstack sudo[109121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539
Jul 03 13:20:07 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:08 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a.df816930-4b76-49e8-a6a2-57592a835dcd" returned: 0 in 0.711s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-df816930-4b76-49e8-a6a2-57592a835dcd" released by "_delete_snapshot" :: held 3.356s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-81893277-32cb-494b-85e6-d5a2b65d021a" released by "delete_snapshot" :: held 3.386s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:08 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539" returned: 0 in 0.858s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:08 devstack sudo[109151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b 1G
Jul 03 13:20:08 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:08 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Created reservations ['4d3839ad-e20b-4749-926b-9edb15bb47fd', 'f18af5d8-475e-45cc-b554-0b8f87d1f785', 'aaf12e99-21a6-41c9-b3c3-4f747553e1b3', '332742e4-2b38-4ba7-a3ff-d1ceb5e2389e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:08 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Delete snapshot completed successfully.
Jul 03 13:20:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-6c85718d-8f28-41b6-a5f1-d38317c2b4ed tempest-ProjectMemberTests-144615743 None] Lock "cinder-df816930-4b76-49e8-a6a2-57592a835dcd-delete_snapshot" released by "delete_snapshot" :: held 3.584s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-81893277-32cb-494b-85e6-d5a2b65d021a-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Lock "cinder-81893277-32cb-494b-85e6-d5a2b65d021a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-81893277-32cb-494b-85e6-d5a2b65d021a" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-81893277-32cb-494b-85e6-d5a2b65d021a" acquired by "delete_volume" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:09 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[5358b31b-a45a-433c-8c25-a377ef852b31]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:09 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b 1G" returned: 0 in 0.873s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9725b85-4c73-45a1-a967-c142e3184539 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:09 devstack sudo[109158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9725b85-4c73-45a1-a967-c142e3184539 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b
Jul 03 13:20:09 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:09 devstack sudo[109157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a
Jul 03 13:20:09 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:09 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9725b85-4c73-45a1-a967-c142e3184539 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b" returned: 0 in 0.712s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:09 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b is being set with open permissions: ugo+rw
Jul 03 13:20:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:09 devstack sudo[109167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b
Jul 03 13:20:09 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:09 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a" returned: 0 in 0.791s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:09 devstack sudo[109169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a
Jul 03 13:20:09 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:10 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b" returned: 0 in 0.736s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:10 devstack sudo[109173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.info
Jul 03 13:20:10 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:10 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-81893277-32cb-494b-85e6-d5a2b65d021a" returned: 0 in 0.767s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:10 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-81893277-32cb-494b-85e6-d5a2b65d021a" released by "delete_volume" :: held 1.625s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:10 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Created reservations ['d8aae535-7471-4a9b-9538-fb8d73785950', '7b8ee36a-8410-4845-bd46-9ce4110f126d', 'be098b43-4a37-4cc1-b205-8f66823df9a2', 'b39996aa-f666-45d5-aa3c-dd61371131b6'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:10 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:10 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:10 devstack sudo[109175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:20:10 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:11 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.info" returned: 0 in 0.700s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:11 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.info is being set with open permissions: ugo+rw
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:11 devstack sudo[109179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.info
Jul 03 13:20:11 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:11 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.706s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:20:11 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Deleted volume successfully.
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-0c476f82-eb36-4699-89be-446478f9f8c2 tempest-ProjectMemberTests-144615743 None] Lock "cinder-81893277-32cb-494b-85e6-d5a2b65d021a-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (d5cec371-343b-470f-9578-166118b5b908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21daa8a4-1d18-453f-ab22-deb8c691303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21daa8a4-1d18-453f-ab22-deb8c691303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509286596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ddda75-9809-49f1-9698-909e1146565d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:12Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f803033c-04f6-4c26-a62b-dd407d709e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f803033c-04f6-4c26-a62b-dd407d709e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659ac8db-9774-4bb4-a37b-ac481c4f8b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659ac8db-9774-4bb4-a37b-ac481c4f8b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ddda75-9809-49f1-9698-909e1146565d', 'volume_name': 'volume-f2ddda75-9809-49f1-9698-909e1146565d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba668db-e744-4312-91dd-45ac80886694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba668db-e744-4312-91dd-45ac80886694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5799a672-5fbd-483c-b21a-61efb0743346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:11 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Volume f2ddda75-9809-49f1-9698-909e1146565d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ddda75-9809-49f1-9698-909e1146565d', 'volume_size': 1}
Jul 03 13:20:11 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:12 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.info" returned: 0 in 0.711s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.725s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.192s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509286596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ddda75-9809-49f1-9698-909e1146565d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:12Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Creating volume f2ddda75-9809-49f1-9698-909e1146565d {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:20:12 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:12 devstack sudo[109183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d 1073741824
Jul 03 13:20:12 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:12 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4d4bf137-b329-4252-afcf-ce450f312725 tempest-ProjectReaderTests-563782695 None] Create snapshot completed successfully
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-bfa22d63-19d6-4553-a44d-0eddf96bb87b-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Lock "cinder-bfa22d63-19d6-4553-a44d-0eddf96bb87b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-a9725b85-4c73-45a1-a967-c142e3184539" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-a9725b85-4c73-45a1-a967-c142e3184539" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-bfa22d63-19d6-4553-a44d-0eddf96bb87b" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-bfa22d63-19d6-4553-a44d-0eddf96bb87b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Deleting offline snapshot bfa22d63-19d6-4553-a44d-0eddf96bb87b of volume a9725b85-4c73-45a1-a967-c142e3184539 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] snapshot_file for this snap is: volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf54b4d7-26a6-4199-bf13-0bcaa261fbe4]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:12 devstack sudo[109188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b
Jul 03 13:20:12 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:12 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d 1073741824" returned: 0 in 0.851s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:12 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:12 devstack sudo[109191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d
Jul 03 13:20:12 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:13 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b" returned: 0 in 0.830s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9725b85-4c73-45a1-a967-c142e3184539(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:20:13 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[89994b76-1e84-47e8-9a67-56ef7b16ce7f]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:13 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d" returned: 0 in 0.682s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:13 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:20:13 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:13 devstack sudo[109196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539
Jul 03 13:20:13 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5799a672-5fbd-483c-b21a-61efb0743346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ddda75-9809-49f1-9698-909e1146565d', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1617541d-9eec-449c-9775-554fe0eae278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:13 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Volume volume-f2ddda75-9809-49f1-9698-909e1146565d (f2ddda75-9809-49f1-9698-909e1146565d): created successfully
Jul 03 13:20:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1617541d-9eec-449c-9775-554fe0eae278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:13 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (d5cec371-343b-470f-9578-166118b5b908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:13 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b1f27def-fe41-446e-a904-7ec04b4f5120 tempest-ProjectMemberTests-144615743 None] Created volume successfully.
Jul 03 13:20:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:14 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] Creating offline snapshot 5cc8a524-be9e-4503-938c-e0f1ada4da02 of volume f2ddda75-9809-49f1-9698-909e1146565d {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:20:14 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1be414-9b34-4fa4-a18e-cf3690d14b9d]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:14 devstack sudo[109199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d
Jul 03 13:20:14 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:14 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539" returned: 0 in 0.835s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:14 devstack sudo[109204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b
Jul 03 13:20:14 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:14 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d" returned: 0 in 0.795s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:14 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:14 devstack sudo[109209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02 1G
Jul 03 13:20:14 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:15 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b" returned: 0 in 0.762s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:15 devstack sudo[109214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b
Jul 03 13:20:15 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:15 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02 1G" returned: 0 in 0.861s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2ddda75-9809-49f1-9698-909e1146565d -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:15 devstack sudo[109220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2ddda75-9809-49f1-9698-909e1146565d -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02
Jul 03 13:20:15 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:15 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:15 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539.bfa22d63-19d6-4553-a44d-0eddf96bb87b" returned: 0 in 0.691s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-bfa22d63-19d6-4553-a44d-0eddf96bb87b" released by "_delete_snapshot" :: held 3.213s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-a9725b85-4c73-45a1-a967-c142e3184539" released by "delete_snapshot" :: held 3.238s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:15 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Created reservations ['bbde4ed2-edce-45cc-a77d-dc96be0cd269', 'dd061ad8-e2e5-4898-a8d4-25cc04e76255', 'ecac0cce-f447-44ab-9ad6-184aae2a57fd', '07d49ec2-7e93-48ff-bba2-10b1ae944437'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:15 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Delete snapshot completed successfully.
Jul 03 13:20:15 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-97f054d5-ac47-4ce8-8d29-a11725e6e85c tempest-ProjectReaderTests-563782695 None] Lock "cinder-bfa22d63-19d6-4553-a44d-0eddf96bb87b-delete_snapshot" released by "delete_snapshot" :: held 3.381s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:16 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2ddda75-9809-49f1-9698-909e1146565d -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02" returned: 0 in 0.755s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:16 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02 is being set with open permissions: ugo+rw
Jul 03 13:20:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:16 devstack sudo[109225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02
Jul 03 13:20:16 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-a9725b85-4c73-45a1-a967-c142e3184539-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Lock "cinder-a9725b85-4c73-45a1-a967-c142e3184539-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-a9725b85-4c73-45a1-a967-c142e3184539" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:16 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-a9725b85-4c73-45a1-a967-c142e3184539" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:16 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c93797e-ee2a-488b-877d-9577d853e377]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:16 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:17 devstack sudo[109227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539
Jul 03 13:20:17 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:17 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02" returned: 0 in 0.669s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:17 devstack sudo[109230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.info
Jul 03 13:20:17 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:17 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539" returned: 0 in 0.781s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:17 devstack sudo[109236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539
Jul 03 13:20:17 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:17 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.info" returned: 0 in 0.640s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:17 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.info is being set with open permissions: ugo+rw
Jul 03 13:20:17 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:17 devstack sudo[109238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.info
Jul 03 13:20:17 devstack sudo[109238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:18 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-a9725b85-4c73-45a1-a967-c142e3184539" returned: 0 in 0.628s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:18 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-a9725b85-4c73-45a1-a967-c142e3184539" released by "delete_volume" :: held 1.467s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:18 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Created reservations ['ad777993-0620-4766-8772-f385372a68af', '7fc7317f-3a88-4066-8b60-b83450d2ccb4', 'f48617b3-4710-48e0-a616-8c4627a3024c', '722d2ea7-9b29-4bb4-9ef8-0fc3afe4134c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:18 devstack sudo[109238]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.info" returned: 0 in 0.614s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:18 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-b823d91d-8ce6-4d90-acc3-7e6d1af37680 tempest-ProjectMemberTests-144615743 None] Create snapshot completed successfully
Jul 03 13:20:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:18 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:18 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:18 devstack sudo[109242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:20:18 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:19 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.618s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:20:19 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Deleted volume successfully.
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dd1b913b-7588-4b33-bf2a-96cb5e621126 tempest-ProjectReaderTests-563782695 None] Lock "cinder-a9725b85-4c73-45a1-a967-c142e3184539-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-5cc8a524-be9e-4503-938c-e0f1ada4da02-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Lock "cinder-5cc8a524-be9e-4503-938c-e0f1ada4da02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-f2ddda75-9809-49f1-9698-909e1146565d" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-f2ddda75-9809-49f1-9698-909e1146565d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-5cc8a524-be9e-4503-938c-e0f1ada4da02" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-5cc8a524-be9e-4503-938c-e0f1ada4da02" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Deleting offline snapshot 5cc8a524-be9e-4503-938c-e0f1ada4da02 of volume f2ddda75-9809-49f1-9698-909e1146565d {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] snapshot_file for this snap is: volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c55891-175e-4979-8de4-51c38764fe3c]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:19 devstack sudo[109245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02
Jul 03 13:20:19 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (3f0bab1f-fc18-416d-901d-37a5b028f705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3db5b30-89b2-4dd3-b53c-4f5ca32dbb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3db5b30-89b2-4dd3-b53c-4f5ca32dbb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-727408689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0530e14c-28c7-4087-9653-9dbebc784117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:19Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88948f89-ff8c-4a66-a654-30212ce83e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88948f89-ff8c-4a66-a654-30212ce83e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950076a9-3685-42e7-9853-f095a87d9c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950076a9-3685-42e7-9853-f095a87d9c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0530e14c-28c7-4087-9653-9dbebc784117', 'volume_name': 'volume-0530e14c-28c7-4087-9653-9dbebc784117', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80364180-6187-4bef-b9d0-25c66fc5b8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80364180-6187-4bef-b9d0-25c66fc5b8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45291fd-0e16-4470-80d9-47ae6c594291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:19 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Volume 0530e14c-28c7-4087-9653-9dbebc784117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0530e14c-28c7-4087-9653-9dbebc784117', 'volume_size': 1}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-727408689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0530e14c-28c7-4087-9653-9dbebc784117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bb7f19c5dbe4c9c9e83d1e5aad301a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:19Z,use_quota=True,user_id='93e59f949e234cdaa90ab07148b8a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Creating volume 0530e14c-28c7-4087-9653-9dbebc784117 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:20:19 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:20:19 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:19 devstack sudo[109247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117 1073741824
Jul 03 13:20:19 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:20 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02" returned: 0 in 0.753s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:20 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2ddda75-9809-49f1-9698-909e1146565d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:20:20 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c5d813-aa99-44a4-8a46-eb275937a337]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:20 devstack sudo[109254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d
Jul 03 13:20:20 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:20 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117 1073741824" returned: 0 in 0.818s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:20 devstack sudo[109257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117
Jul 03 13:20:20 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:20 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d" returned: 0 in 0.808s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:20 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:20 devstack sudo[109262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02
Jul 03 13:20:20 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:21 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117" returned: 0 in 0.676s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45291fd-0e16-4470-80d9-47ae6c594291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0530e14c-28c7-4087-9653-9dbebc784117', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77c9a5f-6508-4827-96c6-7081cf43037c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:21 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Volume volume-0530e14c-28c7-4087-9653-9dbebc784117 (0530e14c-28c7-4087-9653-9dbebc784117): created successfully
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77c9a5f-6508-4827-96c6-7081cf43037c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Flow 'volume_create_manager' (3f0bab1f-fc18-416d-901d-37a5b028f705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:21 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6aec6d2b-505e-4e51-af03-d82777a49a37 tempest-ProjectReaderTests-563782695 None] Created volume successfully.
Jul 03 13:20:21 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02" returned: 0 in 0.752s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:21 devstack sudo[109269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02
Jul 03 13:20:21 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] Creating offline snapshot d6e927e8-21d9-471d-b056-b9af93d8ab64 of volume 0530e14c-28c7-4087-9653-9dbebc784117 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aefb22-e64f-45cd-80c0-cb4ce581d740]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:21 devstack sudo[109271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117
Jul 03 13:20:21 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:22 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d.5cc8a524-be9e-4503-938c-e0f1ada4da02" returned: 0 in 0.620s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-5cc8a524-be9e-4503-938c-e0f1ada4da02" released by "_delete_snapshot" :: held 3.042s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-f2ddda75-9809-49f1-9698-909e1146565d" released by "delete_snapshot" :: held 3.068s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:22 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Created reservations ['6c8b0b42-c795-4db5-8fae-2b136bdeedcc', '327d919a-dce9-4261-a8eb-57f06e627930', 'cd8a190e-9ade-4a77-a096-9e74bd919495', '725cd433-328e-4b4c-87e6-4f393e1d668c'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Delete snapshot completed successfully.
Jul 03 13:20:22 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-664e781b-758a-46f0-bc71-edc87d9df879 tempest-ProjectMemberTests-144615743 None] Lock "cinder-5cc8a524-be9e-4503-938c-e0f1ada4da02-delete_snapshot" released by "delete_snapshot" :: held 3.205s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:22 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117" returned: 0 in 0.757s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:22 devstack sudo[109278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64 1G
Jul 03 13:20:22 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:23 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64 1G" returned: 0 in 0.751s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0530e14c-28c7-4087-9653-9dbebc784117 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:23 devstack sudo[109283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0530e14c-28c7-4087-9653-9dbebc784117 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64
Jul 03 13:20:23 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-f2ddda75-9809-49f1-9698-909e1146565d-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Lock "cinder-f2ddda75-9809-49f1-9698-909e1146565d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-f2ddda75-9809-49f1-9698-909e1146565d" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-f2ddda75-9809-49f1-9698-909e1146565d" acquired by "delete_volume" :: waited 0.023s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2807d9f-cef0-4035-9985-c659ed927467]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:23 devstack sudo[109285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d
Jul 03 13:20:23 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:23 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0530e14c-28c7-4087-9653-9dbebc784117 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64" returned: 0 in 0.697s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:23 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64 is being set with open permissions: ugo+rw
Jul 03 13:20:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:23 devstack sudo[109290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64
Jul 03 13:20:23 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:24 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d" returned: 0 in 0.727s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:24 devstack sudo[109295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d
Jul 03 13:20:24 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:24 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64" returned: 0 in 0.640s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:24 devstack sudo[109298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.info
Jul 03 13:20:24 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:24 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-f2ddda75-9809-49f1-9698-909e1146565d" returned: 0 in 0.625s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:24 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-f2ddda75-9809-49f1-9698-909e1146565d" released by "delete_volume" :: held 1.411s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Created reservations ['8198c85e-3562-4027-85ce-87dcfb487733', '4f773182-ef37-4457-96d1-7a10a1e661b7', 'b302d983-363f-4d8a-9f1b-3693299eca8e', 'bd1c5f86-6b0e-43d3-8037-a765128e0022'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:25 devstack sudo[109301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:20:25 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:25 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.info" returned: 0 in 0.629s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:25 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.info is being set with open permissions: ugo+rw
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:25 devstack sudo[109304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.info
Jul 03 13:20:25 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:25 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.642s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:20:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Deleted volume successfully.
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-e8164600-90e0-4556-9c51-df710d201337 tempest-ProjectMemberTests-144615743 None] Lock "cinder-f2ddda75-9809-49f1-9698-909e1146565d-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:25 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.info" returned: 0 in 0.634s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.206s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-6405704f-c93f-44d7-9acc-b9c53add193b tempest-ProjectReaderTests-563782695 None] Create snapshot completed successfully
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (664bc0af-d393-407b-a6fa-53240b87cdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810efa34-04a0-4dec-a247-c85eadce8042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810efa34-04a0-4dec-a247-c85eadce8042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1773800498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e45c2f-517e-4475-98b7-77e034373514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:26Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff3dee4-284c-4239-abd9-a5c1f066a77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff3dee4-284c-4239-abd9-a5c1f066a77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b5e616-69d8-4ead-95fe-c35426bc0b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b5e616-69d8-4ead-95fe-c35426bc0b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e45c2f-517e-4475-98b7-77e034373514', 'volume_name': 'volume-71e45c2f-517e-4475-98b7-77e034373514', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca2bf45-d711-4fd6-a7a0-b2131a718976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca2bf45-d711-4fd6-a7a0-b2131a718976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2f65f5-5a6a-4454-b3ab-4a366cd28235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Volume 71e45c2f-517e-4475-98b7-77e034373514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e45c2f-517e-4475-98b7-77e034373514', 'volume_size': 1}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1773800498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e45c2f-517e-4475-98b7-77e034373514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:26Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Creating volume 71e45c2f-517e-4475-98b7-77e034373514 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:20:26 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:26 devstack sudo[109308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514 1073741824
Jul 03 13:20:26 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-d6e927e8-21d9-471d-b056-b9af93d8ab64-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Lock "cinder-d6e927e8-21d9-471d-b056-b9af93d8ab64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-0530e14c-28c7-4087-9653-9dbebc784117" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-0530e14c-28c7-4087-9653-9dbebc784117" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:26 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-d6e927e8-21d9-471d-b056-b9af93d8ab64" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-d6e927e8-21d9-471d-b056-b9af93d8ab64" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Deleting offline snapshot d6e927e8-21d9-471d-b056-b9af93d8ab64 of volume 0530e14c-28c7-4087-9653-9dbebc784117 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] snapshot_file for this snap is: volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[628ccfe1-cafa-4ab7-be1a-ac216b40324a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:27 devstack sudo[109313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64
Jul 03 13:20:27 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:27 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514 1073741824" returned: 0 in 0.883s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:27 devstack sudo[109316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514
Jul 03 13:20:27 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:27 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64" returned: 0 in 0.769s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0530e14c-28c7-4087-9653-9dbebc784117(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63b2f5c-da7f-43c5-a928-b3768a1d4f95]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:27 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514" returned: 0 in 0.672s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2f65f5-5a6a-4454-b3ab-4a366cd28235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e45c2f-517e-4475-98b7-77e034373514', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8105e21b-44cc-47d2-93ff-335846281286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:27 devstack sudo[109322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117
Jul 03 13:20:27 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Volume volume-71e45c2f-517e-4475-98b7-77e034373514 (71e45c2f-517e-4475-98b7-77e034373514): created successfully
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8105e21b-44cc-47d2-93ff-335846281286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (664bc0af-d393-407b-a6fa-53240b87cdff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-350dad2a-657a-4aec-9afd-6f5674ad7df1 tempest-ProjectMemberTests-144615743 None] Created volume successfully.
Jul 03 13:20:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:28 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] Creating offline snapshot 617d19b0-a940-4174-ba24-61843ae3a6f6 of volume 71e45c2f-517e-4475-98b7-77e034373514 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:20:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f94c619-c021-43d6-b944-4ffc9aac1ea0]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:28 devstack sudo[109325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514
Jul 03 13:20:28 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:28 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117" returned: 0 in 0.830s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:28 devstack sudo[109329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64
Jul 03 13:20:28 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:29 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514" returned: 0 in 0.754s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:29 devstack sudo[109337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6 1G
Jul 03 13:20:29 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:29 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64" returned: 0 in 0.756s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:29 devstack sudo[109339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64
Jul 03 13:20:29 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:30 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6 1G" returned: 0 in 0.779s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e45c2f-517e-4475-98b7-77e034373514 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:30 devstack sudo[109345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e45c2f-517e-4475-98b7-77e034373514 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6
Jul 03 13:20:30 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:30 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117.d6e927e8-21d9-471d-b056-b9af93d8ab64" returned: 0 in 0.656s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-d6e927e8-21d9-471d-b056-b9af93d8ab64" released by "_delete_snapshot" :: held 3.120s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-0530e14c-28c7-4087-9653-9dbebc784117" released by "delete_snapshot" :: held 3.149s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:30 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Created reservations ['f89391d8-ddfb-4526-97b5-af1eabf89ddc', 'badc7c4e-61fb-4ed6-840e-1446a7fe196b', 'f35d695f-22b0-46f2-995d-56c6c5b720d4', '3bb92101-e9fc-44c3-befa-0637d768d06a'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Delete snapshot completed successfully.
Jul 03 13:20:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ed72ecb5-bb0c-4c24-b079-6350ab1d775a tempest-ProjectReaderTests-563782695 None] Lock "cinder-d6e927e8-21d9-471d-b056-b9af93d8ab64-delete_snapshot" released by "delete_snapshot" :: held 3.291s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:30 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e45c2f-517e-4475-98b7-77e034373514 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6" returned: 0 in 0.694s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:30 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6 is being set with open permissions: ugo+rw
Jul 03 13:20:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:30 devstack sudo[109350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6
Jul 03 13:20:30 devstack sudo[109350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-0530e14c-28c7-4087-9653-9dbebc784117-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Lock "cinder-0530e14c-28c7-4087-9653-9dbebc784117-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Acquiring lock "cinder-quobyte-0530e14c-28c7-4087-9653-9dbebc784117" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:31 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-0530e14c-28c7-4087-9653-9dbebc784117" acquired by "delete_volume" :: waited 0.032s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:31 devstack sudo[109350]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6" returned: 0 in 0.787s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:31 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6662af0-2716-4d94-ab26-264c9a8370df]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:31 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:31 devstack sudo[109355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.info
Jul 03 13:20:31 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:31 devstack sudo[109354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117
Jul 03 13:20:31 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:32 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.info" returned: 0 in 0.667s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:32 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.info is being set with open permissions: ugo+rw
Jul 03 13:20:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:32 devstack sudo[109362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.info
Jul 03 13:20:32 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:32 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117" returned: 0 in 0.783s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:32 devstack sudo[109364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117
Jul 03 13:20:32 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:32 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.info" returned: 0 in 0.654s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:32 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bd7bc918-c280-4ffd-9f26-7e69c2d2ffe5 tempest-ProjectMemberTests-144615743 None] Create snapshot completed successfully
Jul 03 13:20:32 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:32 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-0530e14c-28c7-4087-9653-9dbebc784117" returned: 0 in 0.654s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Lock "cinder-quobyte-0530e14c-28c7-4087-9653-9dbebc784117" released by "delete_volume" :: held 1.504s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Created reservations ['26c67a04-bfa8-43bb-820a-8968fa969792', '0f815b6b-afde-4b9d-a21c-301e09b13407', 'ac3e1fbd-6a53-4fd0-8357-d680fa1d7678', 'a0384b3f-a323-405e-b9bd-b5cf1c7fddde'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:33 devstack sudo[109368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:20:33 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-617d19b0-a940-4174-ba24-61843ae3a6f6-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:33 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.633s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Lock "cinder-617d19b0-a940-4174-ba24-61843ae3a6f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-71e45c2f-517e-4475-98b7-77e034373514" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:33 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Deleted volume successfully.
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-71e45c2f-517e-4475-98b7-77e034373514" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-617d19b0-a940-4174-ba24-61843ae3a6f6" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-ea41c0d1-19a6-4188-86e3-4ead10e64d09 tempest-ProjectReaderTests-563782695 None] Lock "cinder-0530e14c-28c7-4087-9653-9dbebc784117-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-617d19b0-a940-4174-ba24-61843ae3a6f6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Deleting offline snapshot 617d19b0-a940-4174-ba24-61843ae3a6f6 of volume 71e45c2f-517e-4475-98b7-77e034373514 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] snapshot_file for this snap is: volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e92cc5-f54c-44f3-8a06-29dced1ad1a5]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:33 devstack sudo[109371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6
Jul 03 13:20:33 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:34 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6" returned: 0 in 0.805s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71e45c2f-517e-4475-98b7-77e034373514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:20:34 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f0e148-6008-49e6-885d-02447d95579b]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:34 devstack sudo[109376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514
Jul 03 13:20:34 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:35 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514" returned: 0 in 0.815s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:35 devstack sudo[109383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6
Jul 03 13:20:35 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:36 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6" returned: 0 in 0.745s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:36 devstack sudo[109389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6
Jul 03 13:20:36 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:36 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514.617d19b0-a940-4174-ba24-61843ae3a6f6" returned: 0 in 0.714s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-617d19b0-a940-4174-ba24-61843ae3a6f6" released by "_delete_snapshot" :: held 3.193s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-71e45c2f-517e-4475-98b7-77e034373514" released by "delete_snapshot" :: held 3.225s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Created reservations ['a04271f9-832c-4172-85b3-c17f61010963', 'e8cbb948-28f7-4758-b6c8-fbd07e445cde', '197baf27-151b-4d93-8c18-2209d815866a', '7b547ca9-7e2f-4e04-a13b-2ddaeeda912d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:37 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Delete snapshot completed successfully.
Jul 03 13:20:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-f20459a1-164c-4608-b0d9-1a73faa51b1f tempest-ProjectMemberTests-144615743 None] Lock "cinder-617d19b0-a940-4174-ba24-61843ae3a6f6-delete_snapshot" released by "delete_snapshot" :: held 3.385s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-71e45c2f-517e-4475-98b7-77e034373514-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Lock "cinder-71e45c2f-517e-4475-98b7-77e034373514-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-71e45c2f-517e-4475-98b7-77e034373514" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-71e45c2f-517e-4475-98b7-77e034373514" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:38 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[c637c0b3-5987-4be0-841a-8713e0414021]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:38 devstack sudo[109392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514
Jul 03 13:20:38 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:38 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514" returned: 0 in 0.780s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:38 devstack sudo[109397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514
Jul 03 13:20:38 devstack sudo[109397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:39 devstack sudo[109397]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-71e45c2f-517e-4475-98b7-77e034373514" returned: 0 in 0.652s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:39 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-71e45c2f-517e-4475-98b7-77e034373514" released by "delete_volume" :: held 1.487s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:39 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Created reservations ['09a42354-c6bf-4895-95e5-ffb9f72887c1', 'c486c0a4-4dd4-4d1c-bb1f-d0e7f844e43d', 'da025c88-7ca0-4c9b-83eb-bf39e07a0bc8', '8b437c12-a684-4fb2-a85a-e8f17ac3c286'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:39 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:39 devstack sudo[109400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:20:39 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:40 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.666s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:20:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Deleted volume successfully.
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-8def53b3-fa9d-48e1-8d06-351feebed5d0 tempest-ProjectMemberTests-144615743 None] Lock "cinder-71e45c2f-517e-4475-98b7-77e034373514-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (27dd9e0a-ee93-4fcd-ab84-c43701227315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9d5112-ff1e-453c-9cb6-527e8e72ee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9d5112-ff1e-453c-9cb6-527e8e72ee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2010234337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1cc3b0-4308-4e9f-b68c-06f8960805b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:41Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ce9b19-9920-475a-baa7-27e7baf4ef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ce9b19-9920-475a-baa7-27e7baf4ef30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54469a2-8f04-49a1-a2e4-21425732ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54469a2-8f04-49a1-a2e4-21425732ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1cc3b0-4308-4e9f-b68c-06f8960805b7', 'volume_name': 'volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53c8c6d-1f32-4624-a7ea-ada2fa9d1d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53c8c6d-1f32-4624-a7ea-ada2fa9d1d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5706d35e-a652-4916-9b29-76aa174c583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:40 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Volume bd1cc3b0-4308-4e9f-b68c-06f8960805b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7', 'volume_size': 1}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2010234337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1cc3b0-4308-4e9f-b68c-06f8960805b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:41Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Creating volume bd1cc3b0-4308-4e9f-b68c-06f8960805b7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:20:40 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:20:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:40 devstack sudo[109403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 1073741824
Jul 03 13:20:40 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:41 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 1073741824" returned: 0 in 0.863s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:41 devstack sudo[109410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7
Jul 03 13:20:41 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:42 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7" returned: 0 in 0.662s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5706d35e-a652-4916-9b29-76aa174c583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ad43a4-2ac1-427b-8387-c2eba3f5bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:42 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Volume volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 (bd1cc3b0-4308-4e9f-b68c-06f8960805b7): created successfully
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ad43a4-2ac1-427b-8387-c2eba3f5bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (27dd9e0a-ee93-4fcd-ab84-c43701227315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:42 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-14a33fc5-6496-44a3-bb72-dbe3e021e07e tempest-ProjectMemberTests-144615743 None] Created volume successfully.
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] Creating offline snapshot e4e04ef1-5db9-44da-a889-7fa5c19e2eee of volume bd1cc3b0-4308-4e9f-b68c-06f8960805b7 {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[97780f71-4266-4867-adbd-e0251030affe]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:43 devstack sudo[109413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7
Jul 03 13:20:43 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:43 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7" returned: 0 in 0.817s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:43 devstack sudo[109419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee 1G
Jul 03 13:20:43 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:44 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee 1G" returned: 0 in 0.929s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:44 devstack sudo[109424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee
Jul 03 13:20:44 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:45 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee" returned: 0 in 0.776s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:45 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee is being set with open permissions: ugo+rw
Jul 03 13:20:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:45 devstack sudo[109429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee
Jul 03 13:20:45 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:46 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee" returned: 0 in 0.684s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:46 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=90,cinder:UPDATE=101,cinder:INSERT=28,cinder:DELETE=9 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:20:46 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=86,cinder:UPDATE=124,cinder:INSERT=33,cinder:DELETE=10 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:20:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:46 devstack sudo[109432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.info
Jul 03 13:20:46 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:46 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.info" returned: 0 in 0.668s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:46 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.info is being set with open permissions: ugo+rw
Jul 03 13:20:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:46 devstack sudo[109435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.info
Jul 03 13:20:46 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:47 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.info" returned: 0 in 0.662s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.636s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-087a7431-db97-40fe-8798-e75dbd6e2063 tempest-ProjectMemberTests-144615743 None] Create snapshot completed successfully
Jul 03 13:20:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-e4e04ef1-5db9-44da-a889-7fa5c19e2eee-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Lock "cinder-e4e04ef1-5db9-44da-a889-7fa5c19e2eee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-bd1cc3b0-4308-4e9f-b68c-06f8960805b7" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-bd1cc3b0-4308-4e9f-b68c-06f8960805b7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-e4e04ef1-5db9-44da-a889-7fa5c19e2eee" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:48 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-e4e04ef1-5db9-44da-a889-7fa5c19e2eee" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Deleting offline snapshot e4e04ef1-5db9-44da-a889-7fa5c19e2eee of volume bd1cc3b0-4308-4e9f-b68c-06f8960805b7 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:20:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] snapshot_file for this snap is: volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:20:48 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7f1296-307b-4182-b37b-e18757577496]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:48 devstack sudo[109438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee
Jul 03 13:20:48 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:49 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee" returned: 0 in 0.769s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:20:49 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[79be445e-1505-49ca-a0a3-c03a507fa9ea]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:49 devstack sudo[109443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7
Jul 03 13:20:49 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:49 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7" returned: 0 in 0.767s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:49 devstack sudo[109449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee
Jul 03 13:20:49 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:50 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee" returned: 0 in 0.765s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:50 devstack sudo[109454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee
Jul 03 13:20:50 devstack sudo[109454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:51 devstack sudo[109454]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7.e4e04ef1-5db9-44da-a889-7fa5c19e2eee" returned: 0 in 0.685s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-e4e04ef1-5db9-44da-a889-7fa5c19e2eee" released by "_delete_snapshot" :: held 3.117s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-bd1cc3b0-4308-4e9f-b68c-06f8960805b7" released by "delete_snapshot" :: held 3.143s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:51 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Created reservations ['9c0732cf-1ae3-4d6d-b8ce-f9f6b9d4cd02', '203b7a59-768f-4680-a327-a89bee96cf09', '45037a01-92d5-4f22-aad7-5917978f731d', '6e66d5dd-b80b-46d1-a4a8-3357d3611212'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:51 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Delete snapshot completed successfully.
Jul 03 13:20:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-3aa005ba-de01-4904-acf8-2234d97d3006 tempest-ProjectMemberTests-144615743 None] Lock "cinder-e4e04ef1-5db9-44da-a889-7fa5c19e2eee-delete_snapshot" released by "delete_snapshot" :: held 3.323s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-bd1cc3b0-4308-4e9f-b68c-06f8960805b7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Lock "cinder-bd1cc3b0-4308-4e9f-b68c-06f8960805b7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-bd1cc3b0-4308-4e9f-b68c-06f8960805b7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:20:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-bd1cc3b0-4308-4e9f-b68c-06f8960805b7" acquired by "delete_volume" :: waited 0.026s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:20:52 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53af85d-6c69-4ceb-be81-3776b563589d]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:52 devstack sudo[109458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7
Jul 03 13:20:52 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:53 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7" returned: 0 in 0.828s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:53 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:53 devstack sudo[109463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7
Jul 03 13:20:53 devstack sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:54 devstack sudo[109463]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-bd1cc3b0-4308-4e9f-b68c-06f8960805b7" returned: 0 in 0.676s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-bd1cc3b0-4308-4e9f-b68c-06f8960805b7" released by "delete_volume" :: held 1.568s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Created reservations ['ede6e1c8-8759-45da-8b20-1ef6abc38362', 'd905d9d4-1aab-43cb-aa1a-e16bf0912d82', 'a91c1fb2-e692-45d3-bcde-1cf34c904880', 'e77caf98-78fd-4c09-8769-55b69abd655b'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:54 devstack sudo[109466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:20:54 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:54 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.706s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:20:54 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Deleted volume successfully.
Jul 03 13:20:54 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-1177e441-4b6d-412e-aac7-89887b4523d4 tempest-ProjectMemberTests-144615743 None] Lock "cinder-bd1cc3b0-4308-4e9f-b68c-06f8960805b7-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (44b8246e-4ab4-4adc-abef-0349bc1ad867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfede53a-baaf-4ad8-b6db-fd63eab76c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfede53a-baaf-4ad8-b6db-fd63eab76c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867235130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87f51e0-98e0-4f75-8037-862eb5f779ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:55Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de15c5ba-e17e-4498-a14c-6b3cefc4e66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de15c5ba-e17e-4498-a14c-6b3cefc4e66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb68f0d-b34b-4e7e-9129-80e765118c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb68f0d-b34b-4e7e-9129-80e765118c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87f51e0-98e0-4f75-8037-862eb5f779ca', 'volume_name': 'volume-d87f51e0-98e0-4f75-8037-862eb5f779ca', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25277ed3-aad7-4171-8829-deda59d5a109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25277ed3-aad7-4171-8829-deda59d5a109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2da1605-1ab8-4bb9-bdc4-cc651cb738dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:55 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Volume d87f51e0-98e0-4f75-8037-862eb5f779ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87f51e0-98e0-4f75-8037-862eb5f779ca', 'volume_size': 1}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867235130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87f51e0-98e0-4f75-8037-862eb5f779ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8c0489c8ba40ce9ee86a847b9cb6e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:55Z,use_quota=True,user_id='daa8115c7827476792f8d668bf0a613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Creating volume d87f51e0-98e0-4f75-8037-862eb5f779ca {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:20:55 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:20:55 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:55 devstack sudo[109469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca 1073741824
Jul 03 13:20:55 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:56 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca 1073741824" returned: 0 in 0.853s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:56 devstack sudo[109475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca
Jul 03 13:20:56 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:56 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca" returned: 0 in 0.758s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:56 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:20:56 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2da1605-1ab8-4bb9-bdc4-cc651cb738dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87f51e0-98e0-4f75-8037-862eb5f779ca', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72f9c59-9546-4024-9ac6-4c2f5a4844d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:56 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Volume volume-d87f51e0-98e0-4f75-8037-862eb5f779ca (d87f51e0-98e0-4f75-8037-862eb5f779ca): created successfully
Jul 03 13:20:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72f9c59-9546-4024-9ac6-4c2f5a4844d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:56 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Flow 'volume_create_manager' (44b8246e-4ab4-4adc-abef-0349bc1ad867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:56 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-aa685295-b0f3-40a5-a8ff-304116998f44 tempest-ProjectMemberTests-144615743 None] Created volume successfully.
Jul 03 13:20:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:57 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] Creating offline snapshot e9538486-accc-4188-aaf3-3d1ec4b112e2 of volume d87f51e0-98e0-4f75-8037-862eb5f779ca {{(pid=86763) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:20:57 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cb9e5a-19fb-44ba-99b2-e82844852723]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:57 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:57 devstack sudo[109478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca
Jul 03 13:20:57 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:58 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca" returned: 0 in 0.767s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:58 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2 1G {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:58 devstack sudo[109483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2 1G
Jul 03 13:20:58 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:59 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2 1G" returned: 0 in 0.800s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87f51e0-98e0-4f75-8037-862eb5f779ca -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:59 devstack sudo[109489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87f51e0-98e0-4f75-8037-862eb5f779ca -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2
Jul 03 13:20:59 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:59 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87f51e0-98e0-4f75-8037-862eb5f779ca -F qcow2 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2" returned: 0 in 0.728s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:59 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2 is being set with open permissions: ugo+rw
Jul 03 13:20:59 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:59 devstack sudo[109494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2
Jul 03 13:20:59 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:00 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2" returned: 0 in 0.656s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:00 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:00 devstack sudo[109497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.info
Jul 03 13:21:00 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:01 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.info" returned: 0 in 0.637s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:01 devstack cinder-volume[86763]: WARNING cinder.volume.drivers.remotefs [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.info is being set with open permissions: ugo+rw
Jul 03 13:21:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.info {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:01 devstack sudo[109500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.info
Jul 03 13:21:01 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:01 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.info" returned: 0 in 0.672s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:01 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.338s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:01 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-733ef1d1-288b-4c65-8712-c0304d0f4016 tempest-ProjectMemberTests-144615743 None] Create snapshot completed successfully
Jul 03 13:21:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-e9538486-accc-4188-aaf3-3d1ec4b112e2-delete_snapshot" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Lock "cinder-e9538486-accc-4188-aaf3-3d1ec4b112e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-d87f51e0-98e0-4f75-8037-862eb5f779ca" by "delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-d87f51e0-98e0-4f75-8037-862eb5f779ca" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-e9538486-accc-4188-aaf3-3d1ec4b112e2" by "_delete_snapshot" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:02 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-e9538486-accc-4188-aaf3-3d1ec4b112e2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Deleting offline snapshot e9538486-accc-4188-aaf3-3d1ec4b112e2 of volume d87f51e0-98e0-4f75-8037-862eb5f779ca {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:21:02 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] snapshot_file for this snap is: volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2 {{(pid=86763) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:21:02 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfee22f-19e5-459b-876f-b68eb7092f5d]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:02 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:02 devstack sudo[109506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2
Jul 03 13:21:02 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:03 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2" returned: 0 in 0.820s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:03 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d87f51e0-98e0-4f75-8037-862eb5f779ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86763) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:21:03 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfaef9c-9366-440c-aa83-562f17d485c6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:03 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:03 devstack sudo[109511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca
Jul 03 13:21:03 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:04 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca" returned: 0 in 0.800s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:04 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:04 devstack sudo[109516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2
Jul 03 13:21:04 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:05 devstack sudo[109521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:21:05 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:05 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2" returned: 0 in 0.753s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:05 devstack sudo[109523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2
Jul 03 13:21:05 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:05 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.702s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:21:05 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca.e9538486-accc-4188-aaf3-3d1ec4b112e2" returned: 0 in 0.701s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:05 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-e9538486-accc-4188-aaf3-3d1ec4b112e2" released by "_delete_snapshot" :: held 3.170s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-d87f51e0-98e0-4f75-8037-862eb5f779ca" released by "delete_snapshot" :: held 3.195s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:06 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Created reservations ['f358cee4-6198-4f60-9ac0-ccffb37d8fd9', '9f2b1dad-f5b8-4a35-8a82-be42f57ddfa8', 'e5b7acd6-cb4e-44ab-b9ab-ef674476c294', '45ebbef6-f6f0-4de2-95fa-4497a6ac1c8d'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:06 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Delete snapshot completed successfully.
Jul 03 13:21:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-dc215f13-0447-48a8-ace3-9b9ad5a4eb60 tempest-ProjectMemberTests-144615743 None] Lock "cinder-e9538486-accc-4188-aaf3-3d1ec4b112e2-delete_snapshot" released by "delete_snapshot" :: held 3.342s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:06 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-d87f51e0-98e0-4f75-8037-862eb5f779ca-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Lock "cinder-d87f51e0-98e0-4f75-8037-862eb5f779ca-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Acquiring lock "cinder-quobyte-d87f51e0-98e0-4f75-8037-862eb5f779ca" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:07 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-d87f51e0-98e0-4f75-8037-862eb5f779ca" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:07 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[f785fffe-5a5c-41c4-8cdb-5b248163e730]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:07 devstack sudo[109533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca
Jul 03 13:21:07 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:07 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca" returned: 0 in 0.771s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:07 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:07 devstack sudo[109572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca
Jul 03 13:21:07 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:08 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-d87f51e0-98e0-4f75-8037-862eb5f779ca" returned: 0 in 0.700s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:08 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Lock "cinder-quobyte-d87f51e0-98e0-4f75-8037-862eb5f779ca" released by "delete_volume" :: held 1.530s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:08 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Created reservations ['2922fdd3-a649-415e-8716-2fe8aadc8c00', '736bc124-a2e3-4920-8cc9-ca2afa96d9ad', 'd04316d8-2c78-4ada-aa94-e529ca83b99b', 'ef6dd246-7b18-4c2e-affb-a1a922d4e433'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:08 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:08 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:08 devstack sudo[109578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:21:08 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:09 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:09 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.648s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:09 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:21:09 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Deleted volume successfully.
Jul 03 13:21:09 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-30bbed7f-5321-4de1-837c-ae31544ffef7 tempest-ProjectMemberTests-144615743 None] Lock "cinder-d87f51e0-98e0-4f75-8037-862eb5f779ca-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:18 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=26,cinder:INSERT=10,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:21:19 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=23,cinder:DELETE=3,cinder:INSERT=9,cinder:UPDATE=34 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Flow 'volume_create_manager' (96bb54ab-5333-4142-8beb-f2a284d75532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfccbef-dac2-4c41-85aa-0e00e14266bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfccbef-dac2-4c41-85aa-0e00e14266bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852964586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb8719f-329d-4792-8a37-d39d4cb1a253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ead26f1437454b8f39e4457a34253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:21Z,use_quota=True,user_id='e824318811a9415c92b2f68f21273c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba4b9bf-3ee5-44f5-8b21-c9c81d3e413f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba4b9bf-3ee5-44f5-8b21-c9c81d3e413f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76578e22-2a4a-4cfc-8040-f094d7e476e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76578e22-2a4a-4cfc-8040-f094d7e476e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb8719f-329d-4792-8a37-d39d4cb1a253', 'volume_name': 'volume-4fb8719f-329d-4792-8a37-d39d4cb1a253', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d5c3fe-3af8-4c90-9e76-45994c2982cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d5c3fe-3af8-4c90-9e76-45994c2982cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb7b38b-1cd8-4f81-8ba3-973608eaa272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:21 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Volume 4fb8719f-329d-4792-8a37-d39d4cb1a253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb8719f-329d-4792-8a37-d39d4cb1a253', 'volume_size': 1}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852964586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb8719f-329d-4792-8a37-d39d4cb1a253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ead26f1437454b8f39e4457a34253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:21Z,use_quota=True,user_id='e824318811a9415c92b2f68f21273c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Creating volume 4fb8719f-329d-4792-8a37-d39d4cb1a253 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:21:21 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:21:21 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:21 devstack sudo[109583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253 1073741824
Jul 03 13:21:21 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:22 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253 1073741824" returned: 0 in 0.803s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:22 devstack sudo[109588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253
Jul 03 13:21:22 devstack sudo[109588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:22 devstack sudo[109588]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253" returned: 0 in 0.637s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:22 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:21:22 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb7b38b-1cd8-4f81-8ba3-973608eaa272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb8719f-329d-4792-8a37-d39d4cb1a253', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00adc9b6-92a2-47c5-be2b-83cba080d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:22 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Volume volume-4fb8719f-329d-4792-8a37-d39d4cb1a253 (4fb8719f-329d-4792-8a37-d39d4cb1a253): created successfully
Jul 03 13:21:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00adc9b6-92a2-47c5-be2b-83cba080d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:22 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Flow 'volume_create_manager' (96bb54ab-5333-4142-8beb-f2a284d75532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:22 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-bfaa572e-31de-4690-bfe1-25ec61278b74 tempest-ProjectReaderTests-22267332 None] Created volume successfully.
Jul 03 13:21:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Acquiring lock "cinder-4fb8719f-329d-4792-8a37-d39d4cb1a253-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Lock "cinder-4fb8719f-329d-4792-8a37-d39d4cb1a253-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Acquiring lock "cinder-quobyte-4fb8719f-329d-4792-8a37-d39d4cb1a253" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:23 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Lock "cinder-quobyte-4fb8719f-329d-4792-8a37-d39d4cb1a253" acquired by "delete_volume" :: waited 0.018s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:23 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5922c03-40f4-4a17-88f9-e6dc438bd380]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:23 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:23 devstack sudo[109591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253
Jul 03 13:21:23 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:24 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253" returned: 0 in 0.792s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:24 devstack sudo[109596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253
Jul 03 13:21:24 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:24 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:24 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-4fb8719f-329d-4792-8a37-d39d4cb1a253" returned: 0 in 0.686s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Lock "cinder-quobyte-4fb8719f-329d-4792-8a37-d39d4cb1a253" released by "delete_volume" :: held 1.518s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:25 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Created reservations ['0a35ea16-9b0b-4d07-9b10-3956ce653e0a', '941b1490-132f-4e54-ab89-fb34825b5a50', '3ccb4543-eee2-4664-876a-50a32485aaff', 'd3ae8f3e-b89d-4197-a739-09fd548578a9'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:25 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:25 devstack sudo[109599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:21:25 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:25 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.646s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:25 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:21:25 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Deleted volume successfully.
Jul 03 13:21:25 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-4190d848-8aa5-4c2f-99c2-b041e8a40af2 tempest-ProjectReaderTests-22267332 None] Lock "cinder-4fb8719f-329d-4792-8a37-d39d4cb1a253-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Flow 'volume_create_manager' (293ade62-720a-435c-8ea8-9f790ce9e170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b5ea51-7870-485d-b0e0-8f7f195a6a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b5ea51-7870-485d-b0e0-8f7f195a6a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-504795045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb6c597-eb14-45b3-bdf7-89077102ff96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ead26f1437454b8f39e4457a34253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:26Z,use_quota=True,user_id='e824318811a9415c92b2f68f21273c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb1b274-38da-4429-9105-e85b2a1c0349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb1b274-38da-4429-9105-e85b2a1c0349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5bfedd-7018-46f1-b1b0-33d0ca154082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5bfedd-7018-46f1-b1b0-33d0ca154082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb6c597-eb14-45b3-bdf7-89077102ff96', 'volume_name': 'volume-7eb6c597-eb14-45b3-bdf7-89077102ff96', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c2af8e-6156-4695-a37e-7ddaefdad112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c2af8e-6156-4695-a37e-7ddaefdad112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb474f71-fd32-4e3d-bb1f-d7ef97fef69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:26 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Volume 7eb6c597-eb14-45b3-bdf7-89077102ff96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb6c597-eb14-45b3-bdf7-89077102ff96', 'volume_size': 1}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-504795045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb6c597-eb14-45b3-bdf7-89077102ff96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ead26f1437454b8f39e4457a34253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:26Z,use_quota=True,user_id='e824318811a9415c92b2f68f21273c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Creating volume 7eb6c597-eb14-45b3-bdf7-89077102ff96 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:21:26 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:26 devstack sudo[109602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96 1073741824
Jul 03 13:21:26 devstack sudo[109602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:26 devstack sudo[109602]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96 1073741824" returned: 0 in 0.777s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:26 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:26 devstack sudo[109608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96
Jul 03 13:21:26 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:27 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96" returned: 0 in 0.638s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:27 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:21:27 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb474f71-fd32-4e3d-bb1f-d7ef97fef69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb6c597-eb14-45b3-bdf7-89077102ff96', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecb9622-628c-4fd8-a591-5f948ca29e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:27 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Volume volume-7eb6c597-eb14-45b3-bdf7-89077102ff96 (7eb6c597-eb14-45b3-bdf7-89077102ff96): created successfully
Jul 03 13:21:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecb9622-628c-4fd8-a591-5f948ca29e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:27 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Flow 'volume_create_manager' (293ade62-720a-435c-8ea8-9f790ce9e170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:27 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-eb5f6800-25e3-4f2c-aad7-442cb9ec4035 tempest-ProjectReaderTests-22267332 None] Created volume successfully.
Jul 03 13:21:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Acquiring lock "cinder-7eb6c597-eb14-45b3-bdf7-89077102ff96-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Lock "cinder-7eb6c597-eb14-45b3-bdf7-89077102ff96-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Acquiring lock "cinder-quobyte-7eb6c597-eb14-45b3-bdf7-89077102ff96" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:28 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Lock "cinder-quobyte-7eb6c597-eb14-45b3-bdf7-89077102ff96" acquired by "delete_volume" :: waited 0.013s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:28 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[beec0dff-38e9-4376-9143-c24583b152d9]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:28 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:28 devstack sudo[109611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96
Jul 03 13:21:28 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:29 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96" returned: 0 in 0.765s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:29 devstack sudo[109617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96
Jul 03 13:21:29 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:29 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-7eb6c597-eb14-45b3-bdf7-89077102ff96" returned: 0 in 0.645s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:29 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Lock "cinder-quobyte-7eb6c597-eb14-45b3-bdf7-89077102ff96" released by "delete_volume" :: held 1.447s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:29 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Created reservations ['fd7d95c2-83d1-4f22-b073-f21d28355f94', '27686dc0-3759-4a11-a5de-0f7c566e0fa0', '9d8a3f78-f47b-42dc-8813-57789e252d3f', 'add43002-e0b2-4761-9655-817c38308e60'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:29 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:29 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:29 devstack sudo[109620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:21:29 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:30 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:30 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.642s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:30 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:21:30 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Deleted volume successfully.
Jul 03 13:21:30 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-26165dc8-f9e0-441e-900b-7a86987e92b9 tempest-ProjectReaderTests-22267332 None] Lock "cinder-7eb6c597-eb14-45b3-bdf7-89077102ff96-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:33 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:21:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Flow 'volume_create_manager' (859303c9-4d42-445a-bfa9-42077d33ab41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:33 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34254d3f-5732-4a00-a45d-e525a20cc610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34254d3f-5732-4a00-a45d-e525a20cc610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909541419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26dc078-82da-4e3f-b8c1-7074747adc96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a02971cc141268a68df6721674792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:34Z,use_quota=True,user_id='dc9a2042b26e4c119827c63348da11a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd9df45-bf64-4585-b21f-dad6cfd20cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd9df45-bf64-4585-b21f-dad6cfd20cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8111a2-1ad3-491d-a9d4-bbc0407d9921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8111a2-1ad3-491d-a9d4-bbc0407d9921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c26dc078-82da-4e3f-b8c1-7074747adc96', 'volume_name': 'volume-c26dc078-82da-4e3f-b8c1-7074747adc96', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f184212b-9b72-4467-a999-822cd9d30425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f184212b-9b72-4467-a999-822cd9d30425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33801152-7a70-4eb5-8a4c-b7b22422e415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:34 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Volume c26dc078-82da-4e3f-b8c1-7074747adc96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c26dc078-82da-4e3f-b8c1-7074747adc96', 'volume_size': 1}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909541419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26dc078-82da-4e3f-b8c1-7074747adc96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a02971cc141268a68df6721674792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:34Z,use_quota=True,user_id='dc9a2042b26e4c119827c63348da11a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Creating volume c26dc078-82da-4e3f-b8c1-7074747adc96 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:21:34 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:34 devstack sudo[109624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96 1073741824
Jul 03 13:21:34 devstack sudo[109624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:34 devstack sudo[109624]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96 1073741824" returned: 0 in 0.790s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:34 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:34 devstack sudo[109630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96
Jul 03 13:21:34 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:35 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96" returned: 0 in 0.733s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:35 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:21:35 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33801152-7a70-4eb5-8a4c-b7b22422e415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c26dc078-82da-4e3f-b8c1-7074747adc96', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151c7c5a-4bed-4210-8228-f3213f5a3c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:35 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Volume volume-c26dc078-82da-4e3f-b8c1-7074747adc96 (c26dc078-82da-4e3f-b8c1-7074747adc96): created successfully
Jul 03 13:21:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151c7c5a-4bed-4210-8228-f3213f5a3c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:35 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Flow 'volume_create_manager' (859303c9-4d42-445a-bfa9-42077d33ab41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:35 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-965f29e0-9d2e-48fa-87e5-7e20066b43f8 tempest-ProjectReaderTests-833236358 None] Created volume successfully.
Jul 03 13:21:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Acquiring lock "cinder-c26dc078-82da-4e3f-b8c1-7074747adc96-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Lock "cinder-c26dc078-82da-4e3f-b8c1-7074747adc96-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Acquiring lock "cinder-quobyte-c26dc078-82da-4e3f-b8c1-7074747adc96" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:36 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Lock "cinder-quobyte-c26dc078-82da-4e3f-b8c1-7074747adc96" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:36 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb0a40b-4918-41b9-9668-e3105af5986a]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:36 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:36 devstack sudo[109633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96
Jul 03 13:21:36 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:37 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96" returned: 0 in 0.771s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:37 devstack sudo[109638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96
Jul 03 13:21:37 devstack sudo[109638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:37 devstack sudo[109638]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-c26dc078-82da-4e3f-b8c1-7074747adc96" returned: 0 in 0.723s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:37 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Lock "cinder-quobyte-c26dc078-82da-4e3f-b8c1-7074747adc96" released by "delete_volume" :: held 1.539s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:37 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Created reservations ['abfbca8e-9659-43ac-837a-fe938d4279c5', '4d91d88d-6580-4b94-8a5b-677398f827f7', '5ef1f761-5631-4cf0-bb9a-a7acf3b89c58', 'b9b48019-16fe-422a-82e5-06f34438792e'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:37 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:37 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:37 devstack sudo[109641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:21:37 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:38 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.696s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:21:38 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Deleted volume successfully.
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-a901373f-f8b6-44ed-9dc4-21f1454714fc tempest-ProjectReaderTests-833236358 None] Lock "cinder-c26dc078-82da-4e3f-b8c1-7074747adc96-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Flow 'volume_create_manager' (d5aaef45-751a-4dfa-a168-44e3eac49841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde37c79-e5ed-48ea-a19f-289a3447a087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde37c79-e5ed-48ea-a19f-289a3447a087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810042686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486592d1-d659-404a-bdec-c1f35f76dbe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a02971cc141268a68df6721674792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:39Z,use_quota=True,user_id='dc9a2042b26e4c119827c63348da11a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47eb9870-5f54-4a17-ac5c-62f3c0382a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47eb9870-5f54-4a17-ac5c-62f3c0382a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3489472d-9bd5-4f97-b091-438fc85d6c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3489472d-9bd5-4f97-b091-438fc85d6c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486592d1-d659-404a-bdec-c1f35f76dbe7', 'volume_name': 'volume-486592d1-d659-404a-bdec-c1f35f76dbe7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a90b48-69e4-4bdc-a9f4-480967e8aab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a90b48-69e4-4bdc-a9f4-480967e8aab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08883fe5-8b4e-491f-bbfb-73cc29c81911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Volume 486592d1-d659-404a-bdec-c1f35f76dbe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486592d1-d659-404a-bdec-c1f35f76dbe7', 'volume_size': 1}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810042686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486592d1-d659-404a-bdec-c1f35f76dbe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a02971cc141268a68df6721674792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:39Z,use_quota=True,user_id='dc9a2042b26e4c119827c63348da11a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Creating volume 486592d1-d659-404a-bdec-c1f35f76dbe7 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:21:38 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:21:38 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:39 devstack sudo[109644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7 1073741824
Jul 03 13:21:39 devstack sudo[109644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:39 devstack sudo[109644]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7 1073741824" returned: 0 in 0.873s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:39 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:39 devstack sudo[109650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7
Jul 03 13:21:39 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:40 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7" returned: 0 in 0.686s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:40 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:21:40 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08883fe5-8b4e-491f-bbfb-73cc29c81911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486592d1-d659-404a-bdec-c1f35f76dbe7', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c72f03-2c5c-424e-8d5a-62d253773ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:40 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Volume volume-486592d1-d659-404a-bdec-c1f35f76dbe7 (486592d1-d659-404a-bdec-c1f35f76dbe7): created successfully
Jul 03 13:21:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c72f03-2c5c-424e-8d5a-62d253773ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:40 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Flow 'volume_create_manager' (d5aaef45-751a-4dfa-a168-44e3eac49841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:40 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-80774a1d-ca2c-4a7c-9eca-5c739987b2ea tempest-ProjectReaderTests-833236358 None] Created volume successfully.
Jul 03 13:21:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Acquiring lock "cinder-486592d1-d659-404a-bdec-c1f35f76dbe7-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Lock "cinder-486592d1-d659-404a-bdec-c1f35f76dbe7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Acquiring lock "cinder-quobyte-486592d1-d659-404a-bdec-c1f35f76dbe7" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:41 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Lock "cinder-quobyte-486592d1-d659-404a-bdec-c1f35f76dbe7" acquired by "delete_volume" :: waited 0.016s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:41 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b24c2b8-d63b-42ca-8276-76c15c66e8d6]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:41 devstack sudo[109653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7
Jul 03 13:21:41 devstack sudo[109653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:41 devstack sudo[109653]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7" returned: 0 in 0.796s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:41 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:41 devstack sudo[109659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7
Jul 03 13:21:41 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:42 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-486592d1-d659-404a-bdec-c1f35f76dbe7" returned: 0 in 0.675s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:42 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Lock "cinder-quobyte-486592d1-d659-404a-bdec-c1f35f76dbe7" released by "delete_volume" :: held 1.506s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:42 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Created reservations ['25d63272-ad77-420c-9df7-cee4f65f6a3d', 'b09e300f-65be-4af3-a3cb-9d2ce0b7c4e4', 'abde1fc8-3eb7-4987-874d-6febf82be9ca', '945f0782-c776-4a08-a692-ef1232f56aad'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:42 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:42 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:42 devstack sudo[109662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:21:42 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:43 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.664s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:21:43 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Deleted volume successfully.
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-74f6154c-f91b-4f55-8321-d7537a1e73e8 tempest-ProjectReaderTests-833236358 None] Lock "cinder-486592d1-d659-404a-bdec-c1f35f76dbe7-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Flow 'volume_create_manager' (6868de3d-fedf-41ac-a604-8e46194e6edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8872a4d3-c54f-4b48-b32f-ae683bd33c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8872a4d3-c54f-4b48-b32f-ae683bd33c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1965188830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9409993d-6c52-4a69-b262-0e446233aae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a02971cc141268a68df6721674792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:44Z,use_quota=True,user_id='dc9a2042b26e4c119827c63348da11a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c7a991-0307-4eb3-b812-3f4495859a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c7a991-0307-4eb3-b812-3f4495859a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36308069-2b28-4689-99b9-aa48a3b70fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36308069-2b28-4689-99b9-aa48a3b70fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9409993d-6c52-4a69-b262-0e446233aae9', 'volume_name': 'volume-9409993d-6c52-4a69-b262-0e446233aae9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50d027e-e158-4364-b35e-3b38847db784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50d027e-e158-4364-b35e-3b38847db784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af459ac2-71cb-40bb-9a8b-9fc0702a4924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:43 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Volume 9409993d-6c52-4a69-b262-0e446233aae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9409993d-6c52-4a69-b262-0e446233aae9', 'volume_size': 1}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1965188830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9409993d-6c52-4a69-b262-0e446233aae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a02971cc141268a68df6721674792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:44Z,use_quota=True,user_id='dc9a2042b26e4c119827c63348da11a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Creating volume 9409993d-6c52-4a69-b262-0e446233aae9 {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:21:43 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:21:43 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:43 devstack sudo[109665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9 1073741824
Jul 03 13:21:43 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:44 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9 1073741824" returned: 0 in 0.850s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:44 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:44 devstack sudo[109670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9
Jul 03 13:21:44 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:45 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9" returned: 0 in 0.649s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af459ac2-71cb-40bb-9a8b-9fc0702a4924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9409993d-6c52-4a69-b262-0e446233aae9', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cff395-f499-4572-b94d-8e256712dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:45 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Volume volume-9409993d-6c52-4a69-b262-0e446233aae9 (9409993d-6c52-4a69-b262-0e446233aae9): created successfully
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cff395-f499-4572-b94d-8e256712dcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Flow 'volume_create_manager' (6868de3d-fedf-41ac-a604-8e46194e6edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:45 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-508eb8c0-32a2-47e0-975d-0b5ae43074a9 tempest-ProjectReaderTests-833236358 None] Created volume successfully.
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Acquiring lock "cinder-9409993d-6c52-4a69-b262-0e446233aae9-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Lock "cinder-9409993d-6c52-4a69-b262-0e446233aae9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Acquiring lock "cinder-quobyte-9409993d-6c52-4a69-b262-0e446233aae9" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Lock "cinder-quobyte-9409993d-6c52-4a69-b262-0e446233aae9" acquired by "delete_volume" :: waited 0.013s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfec936b-28c2-48fc-9ba9-7448edc48681]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:45 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:46 devstack sudo[109673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9
Jul 03 13:21:46 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:46 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9" returned: 0 in 0.704s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:46 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:46 devstack sudo[109678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9
Jul 03 13:21:46 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:47 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-9409993d-6c52-4a69-b262-0e446233aae9" returned: 0 in 0.601s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Lock "cinder-quobyte-9409993d-6c52-4a69-b262-0e446233aae9" released by "delete_volume" :: held 1.340s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Created reservations ['7a8a23c1-ac27-45bf-a42b-3cd4feb12721', 'b585f809-e212-44b3-b017-fc8dbca81649', '19216b97-3260-4997-8527-0c719b3cad99', 'f6180aac-759a-467e-a4d7-d28e22af14f8'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:47 devstack sudo[109681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:21:47 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:47 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.610s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:21:47 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Deleted volume successfully.
Jul 03 13:21:47 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-60554380-79f7-4b94-80ed-eada145a3d46 tempest-ProjectReaderTests-833236358 None] Lock "cinder-9409993d-6c52-4a69-b262-0e446233aae9-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.flows.manager.create_volume [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86763) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Flow 'volume_create_manager' (0eab1b24-bcc3-4b83-a44d-6b18d574e0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4bbcf7-8425-4d81-be17-508c9e151c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4bbcf7-8425-4d81-be17-508c9e151c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1720775708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd760d7c-bccd-46fd-a326-067c00c1431c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a02971cc141268a68df6721674792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:48Z,use_quota=True,user_id='dc9a2042b26e4c119827c63348da11a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe2e063-2391-4651-820a-fd795ba8ffa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe2e063-2391-4651-820a-fd795ba8ffa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac62a87-ff30-4e34-b924-58dc315df01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac62a87-ff30-4e34-b924-58dc315df01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd760d7c-bccd-46fd-a326-067c00c1431c', 'volume_name': 'volume-cd760d7c-bccd-46fd-a326-067c00c1431c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264da2e3-95ed-4de5-8f48-5fb1ac51ba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264da2e3-95ed-4de5-8f48-5fb1ac51ba6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad4d789-c6dd-4cfc-9fa8-bd407b01800b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:48 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Volume cd760d7c-bccd-46fd-a326-067c00c1431c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd760d7c-bccd-46fd-a326-067c00c1431c', 'volume_size': 1}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7273b785ecf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1720775708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd760d7c-bccd-46fd-a326-067c00c1431c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a02971cc141268a68df6721674792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:48Z,use_quota=True,user_id='dc9a2042b26e4c119827c63348da11a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b27218a0-2aeb-47bf-8c03-122be3d48de5),volume_type_id=b27218a0-2aeb-47bf-8c03-122be3d48de5)}" {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.remotefs [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Creating volume cd760d7c-bccd-46fd-a326-067c00c1431c {{(pid=86763) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Selected osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586 as target Quobyte volume. {{(pid=86763) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:21:48 devstack cinder-volume[86763]: INFO cinder.volume.drivers.remotefs [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] casted to osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586
Jul 03 13:21:48 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c 1073741824 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:48 devstack sudo[109684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c 1073741824
Jul 03 13:21:48 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:49 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c 1073741824" returned: 0 in 0.784s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:49 devstack sudo[109690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c
Jul 03 13:21:49 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:49 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c" returned: 0 in 0.598s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:49 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'} {{(pid=86763) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Jul 03 13:21:49 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad4d789-c6dd-4cfc-9fa8-bd407b01800b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd760d7c-bccd-46fd-a326-067c00c1431c', 'volume_size': 1}' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:49 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad348cd3-15c6-4098-bf8d-eaa0575baff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:50 devstack cinder-volume[86763]: INFO cinder.volume.flows.manager.create_volume [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Volume volume-cd760d7c-bccd-46fd-a326-067c00c1431c (cd760d7c-bccd-46fd-a326-067c00c1431c): created successfully
Jul 03 13:21:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad348cd3-15c6-4098-bf8d-eaa0575baff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86763) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:50 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Flow 'volume_create_manager' (0eab1b24-bcc3-4b83-a44d-6b18d574e0e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86763) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:50 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-225f909f-70f2-4342-9d58-2a3c6971c51d tempest-ProjectReaderTests-833236358 None] Created volume successfully.
Jul 03 13:21:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Acquiring lock "cinder-cd760d7c-bccd-46fd-a326-067c00c1431c-delete_volume" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Lock "cinder-cd760d7c-bccd-46fd-a326-067c00c1431c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Acquiring lock "cinder-quobyte-cd760d7c-bccd-46fd-a326-067c00c1431c" by "delete_volume" {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:50 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Lock "cinder-quobyte-cd760d7c-bccd-46fd-a326-067c00c1431c" acquired by "delete_volume" :: waited 0.017s {{(pid=86763) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:50 devstack cinder-volume[86763]: DEBUG oslo.privsep.daemon [-] privsep: reply[44176915-c784-4fb3-98e7-50d3b378a4ed]: (4, 'qcow2') {{(pid=87889) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:50 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:50 devstack sudo[109693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c
Jul 03 13:21:50 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:51 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c" returned: 0 in 0.742s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:51 devstack sudo[109699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c
Jul 03 13:21:51 devstack sudo[109699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:51 devstack sudo[109699]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:51 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79/volume-cd760d7c-bccd-46fd-a326-067c00c1431c" returned: 0 in 0.600s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:51 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Lock "cinder-quobyte-cd760d7c-bccd-46fd-a326-067c00c1431c" released by "delete_volume" :: held 1.381s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:52 devstack cinder-volume[86763]: DEBUG cinder.quota [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Created reservations ['d45130f9-5536-4c64-8112-6e651ed02af7', 'b1225756-797a-4629-b6f4-c648bc8dcd1e', 'a71edde4-3c83-4fa5-b629-bbcf02949c82', '2106f626-2224-463b-9daa-49de585bd5ea'] {{(pid=86763) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:52 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:52 devstack sudo[109702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:21:52 devstack sudo[109702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:52 devstack sudo[109702]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:52 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.612s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:52 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Jul 03 13:21:52 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Deleted volume successfully.
Jul 03 13:21:52 devstack cinder-volume[86763]: DEBUG cinder.coordination [None req-24c8ed60-3da4-44a0-ba6a-be2f29c9081e tempest-ProjectReaderTests-833236358 None] Lock "cinder-cd760d7c-bccd-46fd-a326-067c00c1431c-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=86763) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:02 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:UPDATE=71,cinder:SELECT=45,cinder:INSERT=15,cinder:DELETE=6 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:22:02 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writing DB stats cinder:SELECT=39,cinder:UPDATE=61,cinder:DELETE=6,cinder:INSERT=15 {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:22:05 devstack cinder-volume[86763]: DEBUG oslo_service.periodic_task [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:22:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586': None} {{(pid=86763) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:05 devstack cinder-volume[86763]: DEBUG cinder.volume.drivers.quobyte [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-24265c0e-ce71-4d22-9676-c081b7d0d586'] {{(pid=86763) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86763) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79 {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:05 devstack sudo[109917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79
Jul 03 13:22:05 devstack sudo[109917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:05 devstack sudo[109917]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:05 devstack cinder-volume[86763]: DEBUG oslo_concurrency.processutils [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4c4a94cebf9ca8ec36dc5bbe20182a79" returned: 0 in 0.763s {{(pid=86763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:05 devstack cinder-volume[86763]: DEBUG cinder.manager [None req-627659da-09c1-48cb-b683-6d5b9abd03f3 None None] Notifying Schedulers of capabilities ... {{(pid=86763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}